[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 15:08:07.917264 28227 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.144.254:45551
I20260807 15:08:07.919060 28227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:08:07.920176 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:08:07.941813 28234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:07.942024 28233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:07.942155 28237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:07.945101 28227 server_base.cc:1034] running on GCE node
I20260807 15:08:09.163388 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:08:09.163702 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:08:09.163973 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115289163940 us; error 0 us; skew 500 ppm
I20260807 15:08:09.164975 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:08:09.171319 28227 webserver.cc:460] Webserver started at http://127.27.144.254:46179/ using document root <none> and password file <none>
I20260807 15:08:09.172426 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:08:09.172691 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:08:09.173202 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:08:09.180673 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/master-0-root/instance:
uuid: "51576316e08f417f8b89aa176a3b48f1"
format_stamp: "Formatted at 2026-08-07 15:08:09 on dist-test-slave-27sr"
I20260807 15:08:09.189760 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
I20260807 15:08:09.196203 28243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:09.197688 28227 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:08:09.198107 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/master-0-root
uuid: "51576316e08f417f8b89aa176a3b48f1"
format_stamp: "Formatted at 2026-08-07 15:08:09 on dist-test-slave-27sr"
I20260807 15:08:09.198575 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:08:09.243588 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:08:09.245481 28227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:08:09.246026 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:08:09.333854 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.254:45551
I20260807 15:08:09.333942 28298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.254:45551 every 8 connection(s)
I20260807 15:08:09.342396 28299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:09.370239 28299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1: Bootstrap starting.
I20260807 15:08:09.378118 28299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:09.380275 28299 log.cc:824] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1: Log is configured to *not* fsync() on all Append() calls
I20260807 15:08:09.385547 28299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1: No bootstrap required, opened a new log
I20260807 15:08:09.411298 28299 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51576316e08f417f8b89aa176a3b48f1" member_type: VOTER }
I20260807 15:08:09.412050 28299 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:09.412338 28299 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51576316e08f417f8b89aa176a3b48f1, State: Initialized, Role: FOLLOWER
I20260807 15:08:09.413242 28299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51576316e08f417f8b89aa176a3b48f1" member_type: VOTER }
I20260807 15:08:09.413815 28299 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:08:09.414217 28299 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:08:09.414597 28299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:09.421690 28299 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51576316e08f417f8b89aa176a3b48f1" member_type: VOTER }
I20260807 15:08:09.422748 28299 leader_election.cc:302] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51576316e08f417f8b89aa176a3b48f1; no voters:
I20260807 15:08:09.425130 28299 leader_election.cc:288] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:08:09.425493 28302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:09.428761 28302 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 1 LEADER]: Becoming Leader. State: Replica: 51576316e08f417f8b89aa176a3b48f1, State: Running, Role: LEADER
I20260807 15:08:09.429893 28302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51576316e08f417f8b89aa176a3b48f1" member_type: VOTER }
I20260807 15:08:09.430934 28299 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:08:09.447572 28303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51576316e08f417f8b89aa176a3b48f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51576316e08f417f8b89aa176a3b48f1" member_type: VOTER } }
I20260807 15:08:09.447883 28304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51576316e08f417f8b89aa176a3b48f1. Latest consensus state: current_term: 1 leader_uuid: "51576316e08f417f8b89aa176a3b48f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51576316e08f417f8b89aa176a3b48f1" member_type: VOTER } }
I20260807 15:08:09.448789 28303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:08:09.448809 28304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:08:09.453567 28312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:08:09.467700 28312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:08:09.476812 28227 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 15:08:09.488499 28312 catalog_manager.cc:1347] Generated new cluster ID: 6cc8dbc5bd2f46ccacd44877716fc02f
I20260807 15:08:09.488817 28312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:08:09.509639 28312 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:08:09.512528 28312 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:08:09.525727 28312 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1: Generated new TSK 0
I20260807 15:08:09.526926 28312 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:08:09.545279 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:08:09.555526 28321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:09.557296 28322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:09.562026 28227 server_base.cc:1034] running on GCE node
W20260807 15:08:09.561981 28324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:09.563167 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:08:09.563395 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:08:09.563596 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115289563578 us; error 0 us; skew 500 ppm
I20260807 15:08:09.564306 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:08:09.571749 28227 webserver.cc:460] Webserver started at http://127.27.144.193:42485/ using document root <none> and password file <none>
I20260807 15:08:09.572439 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:08:09.572669 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:08:09.572993 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:08:09.574358 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-0-root/instance:
uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
format_stamp: "Formatted at 2026-08-07 15:08:09 on dist-test-slave-27sr"
I20260807 15:08:09.581108 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 15:08:09.586638 28330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:09.587611 28227 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260807 15:08:09.588006 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-0-root
uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
format_stamp: "Formatted at 2026-08-07 15:08:09 on dist-test-slave-27sr"
I20260807 15:08:09.588338 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:08:09.610044 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:08:09.611426 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:08:09.614470 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:08:09.619875 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:08:09.620214 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 15:08:09.620498 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:08:09.620684 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:09.740113 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.193:38507
I20260807 15:08:09.740237 28394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.193:38507 every 8 connection(s)
I20260807 15:08:09.748476 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:08:09.760706 28400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:09.764576 28401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:09.772647 28227 server_base.cc:1034] running on GCE node
W20260807 15:08:09.774734 28403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:09.776059 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:08:09.776435 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:08:09.776718 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115289776698 us; error 0 us; skew 500 ppm
I20260807 15:08:09.777575 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:08:09.781118 28395 heartbeater.cc:347] Connected to a master server at 127.27.144.254:45551
I20260807 15:08:09.781613 28395 heartbeater.cc:464] Registering TS with master...
I20260807 15:08:09.783087 28395 heartbeater.cc:511] Master 127.27.144.254:45551 requested a full tablet report, sending...
I20260807 15:08:09.784523 28227 webserver.cc:460] Webserver started at http://127.27.144.194:32933/ using document root <none> and password file <none>
I20260807 15:08:09.785164 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:08:09.785449 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:08:09.785784 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:08:09.787405 28261 ts_manager.cc:194] Registered new tserver with Master: 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507)
I20260807 15:08:09.787426 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-1-root/instance:
uuid: "35da3a06e22848089a706c5ed81cc90c"
format_stamp: "Formatted at 2026-08-07 15:08:09 on dist-test-slave-27sr"
I20260807 15:08:09.790933 28261 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55890
I20260807 15:08:09.795233 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260807 15:08:09.800196 28408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:09.801193 28227 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:08:09.801501 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-1-root
uuid: "35da3a06e22848089a706c5ed81cc90c"
format_stamp: "Formatted at 2026-08-07 15:08:09 on dist-test-slave-27sr"
I20260807 15:08:09.801762 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:08:09.820217 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:08:09.821648 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:08:09.824517 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:08:09.828419 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:08:09.828649 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:09.828907 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:08:09.829085 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:09.950868 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.194:41375
I20260807 15:08:09.951046 28470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.194:41375 every 8 connection(s)
I20260807 15:08:09.957744 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:08:09.967650 28475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:09.970875 28476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:09.976481 28472 heartbeater.cc:347] Connected to a master server at 127.27.144.254:45551
I20260807 15:08:09.976863 28472 heartbeater.cc:464] Registering TS with master...
I20260807 15:08:09.978222 28472 heartbeater.cc:511] Master 127.27.144.254:45551 requested a full tablet report, sending...
W20260807 15:08:09.980544 28478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:09.980724 28227 server_base.cc:1034] running on GCE node
I20260807 15:08:09.981598 28261 ts_manager.cc:194] Registered new tserver with Master: 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:09.981968 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:08:09.982229 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:08:09.982419 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115289982406 us; error 0 us; skew 500 ppm
I20260807 15:08:09.983126 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:08:09.983326 28261 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55898
I20260807 15:08:09.988333 28227 webserver.cc:460] Webserver started at http://127.27.144.195:43133/ using document root <none> and password file <none>
I20260807 15:08:09.988999 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:08:09.989235 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:08:09.989552 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:08:09.990981 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-2-root/instance:
uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
format_stamp: "Formatted at 2026-08-07 15:08:09 on dist-test-slave-27sr"
I20260807 15:08:09.997189 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.002s
I20260807 15:08:10.001035 28483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:10.001873 28227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 15:08:10.002390 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-2-root
uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
format_stamp: "Formatted at 2026-08-07 15:08:09 on dist-test-slave-27sr"
I20260807 15:08:10.002717 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786115287678881-28227-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:08:10.044180 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:08:10.046046 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:08:10.047439 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:08:10.049988 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:08:10.050220 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:10.050489 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:08:10.050698 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:10.161186 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.195:39771
I20260807 15:08:10.161303 28547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.195:39771 every 8 connection(s)
I20260807 15:08:10.182418 28549 heartbeater.cc:347] Connected to a master server at 127.27.144.254:45551
I20260807 15:08:10.182825 28549 heartbeater.cc:464] Registering TS with master...
I20260807 15:08:10.183846 28549 heartbeater.cc:511] Master 127.27.144.254:45551 requested a full tablet report, sending...
I20260807 15:08:10.186296 28261 ts_manager.cc:194] Registered new tserver with Master: 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:10.187348 28227 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020509899s
I20260807 15:08:10.188370 28261 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55902
I20260807 15:08:10.193125 28227 test_util.cc:268] Using random seed: 1600543945
I20260807 15:08:10.254679 28261 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55914:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:08:10.259056 28261 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:08:10.430670 28359 tablet_service.cc:1467] Processing CreateTablet for tablet 4d297f80ed4d4d889e91a1a04ca4fb6e (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 15:08:10.433948 28356 tablet_service.cc:1467] Processing CreateTablet for tablet 26236b6e40994f0f82e109182f76e32b (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 15:08:10.436147 28357 tablet_service.cc:1467] Processing CreateTablet for tablet 64d0088290624819a603685d23665f50 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 15:08:10.438227 28360 tablet_service.cc:1467] Processing CreateTablet for tablet f491292245984b0d8d11a84fbbf5d178 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 15:08:10.438259 28355 tablet_service.cc:1467] Processing CreateTablet for tablet 3592f94a979c481a8982c6aba50daf12 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 15:08:10.446303 28354 tablet_service.cc:1467] Processing CreateTablet for tablet a8d4dfb94124461c83fbfb0e8b784808 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 15:08:10.448146 28353 tablet_service.cc:1467] Processing CreateTablet for tablet 381edde009404bf285fabf32d2eaf3d8 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 15:08:10.453436 28357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64d0088290624819a603685d23665f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.464048 28356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26236b6e40994f0f82e109182f76e32b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 15:08:10.464937 28311 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:08:10.469386 28355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3592f94a979c481a8982c6aba50daf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.469049 28351 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9c66d3405f47d28fe65bf86d2f271a (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 15:08:10.468240 28350 tablet_service.cc:1467] Processing CreateTablet for tablet d025293a4e9740599a19750cb0ae98d3 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 15:08:10.472465 28353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 381edde009404bf285fabf32d2eaf3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.482230 28360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f491292245984b0d8d11a84fbbf5d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.484802 28351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9c66d3405f47d28fe65bf86d2f271a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.486505 28350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d025293a4e9740599a19750cb0ae98d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.488176 28359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d297f80ed4d4d889e91a1a04ca4fb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.489576 28354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d4dfb94124461c83fbfb0e8b784808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.546625 28436 tablet_service.cc:1467] Processing CreateTablet for tablet f491292245984b0d8d11a84fbbf5d178 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 15:08:10.548708 28434 tablet_service.cc:1467] Processing CreateTablet for tablet 64d0088290624819a603685d23665f50 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 15:08:10.557655 28433 tablet_service.cc:1467] Processing CreateTablet for tablet 26236b6e40994f0f82e109182f76e32b (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 15:08:10.568641 28434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64d0088290624819a603685d23665f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.566159 28431 tablet_service.cc:1467] Processing CreateTablet for tablet a8d4dfb94124461c83fbfb0e8b784808 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 15:08:10.560032 28435 tablet_service.cc:1467] Processing CreateTablet for tablet 4d297f80ed4d4d889e91a1a04ca4fb6e (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 15:08:10.574194 28430 tablet_service.cc:1467] Processing CreateTablet for tablet 381edde009404bf285fabf32d2eaf3d8 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 15:08:10.568138 28432 tablet_service.cc:1467] Processing CreateTablet for tablet 3592f94a979c481a8982c6aba50daf12 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 15:08:10.597365 28436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f491292245984b0d8d11a84fbbf5d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.592253 28429 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9c66d3405f47d28fe65bf86d2f271a (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 15:08:10.614240 28512 tablet_service.cc:1467] Processing CreateTablet for tablet 4d297f80ed4d4d889e91a1a04ca4fb6e (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 15:08:10.616665 28512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d297f80ed4d4d889e91a1a04ca4fb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.602665 28428 tablet_service.cc:1467] Processing CreateTablet for tablet d025293a4e9740599a19750cb0ae98d3 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 15:08:10.628041 28510 tablet_service.cc:1467] Processing CreateTablet for tablet 26236b6e40994f0f82e109182f76e32b (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 15:08:10.629560 28432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3592f94a979c481a8982c6aba50daf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.623626 28511 tablet_service.cc:1467] Processing CreateTablet for tablet 64d0088290624819a603685d23665f50 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 15:08:10.637691 28513 tablet_service.cc:1467] Processing CreateTablet for tablet f491292245984b0d8d11a84fbbf5d178 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 15:08:10.646683 28431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d4dfb94124461c83fbfb0e8b784808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.641861 28509 tablet_service.cc:1467] Processing CreateTablet for tablet 3592f94a979c481a8982c6aba50daf12 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 15:08:10.650167 28510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26236b6e40994f0f82e109182f76e32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.657065 28506 tablet_service.cc:1467] Processing CreateTablet for tablet 0c9c66d3405f47d28fe65bf86d2f271a (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 15:08:10.663511 28507 tablet_service.cc:1467] Processing CreateTablet for tablet 381edde009404bf285fabf32d2eaf3d8 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 15:08:10.660650 28435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d297f80ed4d4d889e91a1a04ca4fb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.653113 28508 tablet_service.cc:1467] Processing CreateTablet for tablet a8d4dfb94124461c83fbfb0e8b784808 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 15:08:10.666548 28505 tablet_service.cc:1467] Processing CreateTablet for tablet d025293a4e9740599a19750cb0ae98d3 (DEFAULT_TABLE table=test-workload [id=aef788acb07146d0a258002c40942717]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 15:08:10.669308 28511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64d0088290624819a603685d23665f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.683879 28428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d025293a4e9740599a19750cb0ae98d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.687341 28509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3592f94a979c481a8982c6aba50daf12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.694921 28429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9c66d3405f47d28fe65bf86d2f271a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.692763 28507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 381edde009404bf285fabf32d2eaf3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.717473 28430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 381edde009404bf285fabf32d2eaf3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.717518 28508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d4dfb94124461c83fbfb0e8b784808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.733071 28433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26236b6e40994f0f82e109182f76e32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.731619 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f491292245984b0d8d11a84fbbf5d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.752274 28505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d025293a4e9740599a19750cb0ae98d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.753677 28506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c9c66d3405f47d28fe65bf86d2f271a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:10.792747 28569 tablet_bootstrap.cc:492] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:10.798095 28395 heartbeater.cc:503] Master 127.27.144.254:45551 was elected leader, sending a full tablet report...
I20260807 15:08:10.815218 28572 tablet_bootstrap.cc:492] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
I20260807 15:08:10.858516 28571 tablet_bootstrap.cc:492] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:10.931977 28572 tablet_bootstrap.cc:654] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:10.937386 28569 tablet_bootstrap.cc:654] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:10.984906 28571 tablet_bootstrap.cc:654] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:10.986876 28472 heartbeater.cc:503] Master 127.27.144.254:45551 was elected leader, sending a full tablet report...
I20260807 15:08:11.009768 28572 tablet_bootstrap.cc:492] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:11.010479 28572 ts_tablet_manager.cc:1397] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.197s user 0.015s sys 0.010s
I20260807 15:08:11.025158 28569 tablet_bootstrap.cc:492] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:11.026376 28569 ts_tablet_manager.cc:1397] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.271s user 0.017s sys 0.036s
I20260807 15:08:11.025936 28572 raft_consensus.cc:348] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.029862 28572 raft_consensus.cc:374] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.031829 28572 raft_consensus.cc:729] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.032953 28571 tablet_bootstrap.cc:492] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:11.034147 28571 ts_tablet_manager.cc:1397] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.209s user 0.010s sys 0.016s
I20260807 15:08:11.034646 28572 consensus_queue.cc:260] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.038368 28569 raft_consensus.cc:348] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.039592 28569 raft_consensus.cc:374] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.040246 28569 raft_consensus.cc:729] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.039747 28571 raft_consensus.cc:348] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.041184 28571 raft_consensus.cc:374] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.041802 28571 raft_consensus.cc:729] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.043422 28571 consensus_queue.cc:260] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.044843 28569 consensus_queue.cc:260] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.047123 28549 heartbeater.cc:503] Master 127.27.144.254:45551 was elected leader, sending a full tablet report...
I20260807 15:08:11.048333 28572 ts_tablet_manager.cc:1428] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.037s user 0.009s sys 0.014s
I20260807 15:08:11.049679 28572 tablet_bootstrap.cc:492] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
I20260807 15:08:11.073766 28572 tablet_bootstrap.cc:654] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.074260 28569 ts_tablet_manager.cc:1428] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.047s user 0.014s sys 0.013s
I20260807 15:08:11.075448 28569 tablet_bootstrap.cc:492] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:11.073704 28571 ts_tablet_manager.cc:1428] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.039s user 0.011s sys 0.007s
I20260807 15:08:11.080596 28571 tablet_bootstrap.cc:492] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:11.088501 28569 tablet_bootstrap.cc:654] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.093214 28571 tablet_bootstrap.cc:654] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.101038 28577 raft_consensus.cc:482] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.101670 28577 raft_consensus.cc:504] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.104720 28572 tablet_bootstrap.cc:492] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:11.105628 28572 ts_tablet_manager.cc:1397] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.056s user 0.019s sys 0.011s
I20260807 15:08:11.107456 28577 leader_election.cc:288] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:11.144346 28572 raft_consensus.cc:348] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.150061 28572 raft_consensus.cc:374] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.151832 28572 raft_consensus.cc:729] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
W20260807 15:08:11.170178 28550 tablet.cc:2369] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:08:11.170334 28572 consensus_queue.cc:260] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.174728 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.181351 28572 ts_tablet_manager.cc:1428] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.075s user 0.005s sys 0.010s
I20260807 15:08:11.182799 28572 tablet_bootstrap.cc:492] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
W20260807 15:08:11.188413 28410 leader_election.cc:341] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.196169 28576 raft_consensus.cc:482] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.197314 28576 raft_consensus.cc:504] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.199422 28569 tablet_bootstrap.cc:492] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:11.200201 28569 ts_tablet_manager.cc:1397] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.125s user 0.018s sys 0.032s
I20260807 15:08:11.202814 28571 tablet_bootstrap.cc:492] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:11.206085 28576 leader_election.cc:288] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.213225 28571 ts_tablet_manager.cc:1397] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.129s user 0.030s sys 0.021s
I20260807 15:08:11.233873 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:11.240573 28572 tablet_bootstrap.cc:654] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
W20260807 15:08:11.243575 28410 leader_election.cc:341] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.245146 28410 leader_election.cc:302] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c; no voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:11.234949 28569 raft_consensus.cc:348] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.247184 28569 raft_consensus.cc:374] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.247334 28577 raft_consensus.cc:2726] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:11.248030 28569 raft_consensus.cc:729] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.249336 28569 consensus_queue.cc:260] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.250574 28571 raft_consensus.cc:348] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.257836 28569 ts_tablet_manager.cc:1428] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.057s user 0.001s sys 0.013s
I20260807 15:08:11.258798 28571 raft_consensus.cc:374] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.260700 28571 raft_consensus.cc:729] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.264664 28571 consensus_queue.cc:260] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.269035 28571 ts_tablet_manager.cc:1428] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.049s user 0.007s sys 0.006s
I20260807 15:08:11.270856 28571 tablet_bootstrap.cc:492] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:11.269017 28569 tablet_bootstrap.cc:492] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:11.304656 28569 tablet_bootstrap.cc:654] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.305613 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3592f94a979c481a8982c6aba50daf12" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
W20260807 15:08:11.307528 28485 leader_election.cc:341] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.307968 28572 tablet_bootstrap.cc:492] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:11.308637 28572 ts_tablet_manager.cc:1397] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.126s user 0.012s sys 0.024s
I20260807 15:08:11.314316 28572 raft_consensus.cc:348] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.315639 28572 raft_consensus.cc:374] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.316172 28572 raft_consensus.cc:729] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.317682 28572 consensus_queue.cc:260] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.321754 28571 tablet_bootstrap.cc:654] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.339126 28572 ts_tablet_manager.cc:1428] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.030s user 0.008s sys 0.003s
I20260807 15:08:11.338438 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3592f94a979c481a8982c6aba50daf12" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:11.344228 28572 tablet_bootstrap.cc:492] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
W20260807 15:08:11.344388 28484 leader_election.cc:341] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.345412 28577 raft_consensus.cc:482] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.350368 28484 leader_election.cc:302] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115; no voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:11.352550 28577 raft_consensus.cc:504] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.356382 28576 raft_consensus.cc:2726] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:11.359957 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:11.363811 28569 tablet_bootstrap.cc:492] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:11.360621 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.364720 28569 ts_tablet_manager.cc:1397] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.096s user 0.019s sys 0.022s
W20260807 15:08:11.365861 28410 leader_election.cc:341] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.357851 28577 leader_election.cc:288] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
W20260807 15:08:11.367265 28410 leader_election.cc:341] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.367707 28410 leader_election.cc:302] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c; no voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:11.368770 28577 raft_consensus.cc:2726] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:11.370154 28578 raft_consensus.cc:482] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.370775 28578 raft_consensus.cc:504] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.374758 28576 raft_consensus.cc:482] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.375293 28576 raft_consensus.cc:504] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.376327 28571 tablet_bootstrap.cc:492] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:11.376911 28571 ts_tablet_manager.cc:1397] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.106s user 0.013s sys 0.022s
I20260807 15:08:11.377556 28576 leader_election.cc:288] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.378857 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.380744 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:11.383284 28569 raft_consensus.cc:348] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
W20260807 15:08:11.389865 28484 leader_election.cc:341] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.389639 28571 raft_consensus.cc:348] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.387979 28569 raft_consensus.cc:374] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.390771 28571 raft_consensus.cc:374] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.391800 28569 raft_consensus.cc:729] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.393821 28571 raft_consensus.cc:729] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.383719 28578 leader_election.cc:288] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:11.395414 28571 consensus_queue.cc:260] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.395839 28569 consensus_queue.cc:260] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.405210 28569 ts_tablet_manager.cc:1428] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.040s user 0.011s sys 0.003s
I20260807 15:08:11.409780 28572 tablet_bootstrap.cc:654] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
W20260807 15:08:11.409653 28485 leader_election.cc:341] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.406797 28569 tablet_bootstrap.cc:492] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:11.410617 28485 leader_election.cc:302] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115; no voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:11.413213 28576 raft_consensus.cc:2726] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:11.419130 28571 ts_tablet_manager.cc:1428] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.042s user 0.014s sys 0.001s
I20260807 15:08:11.422461 28571 tablet_bootstrap.cc:492] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:11.455600 28569 tablet_bootstrap.cc:654] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.462109 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
W20260807 15:08:11.464880 28331 leader_election.cc:341] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.467011 28572 tablet_bootstrap.cc:492] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:11.467764 28572 ts_tablet_manager.cc:1397] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.124s user 0.022s sys 0.019s
W20260807 15:08:11.473450 28311 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:08:11.474673 28571 tablet_bootstrap.cc:654] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.473765 28572 raft_consensus.cc:348] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.477823 28572 raft_consensus.cc:374] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.478317 28572 raft_consensus.cc:729] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.479445 28572 consensus_queue.cc:260] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.482079 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:11.484835 28572 ts_tablet_manager.cc:1428] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.017s user 0.010s sys 0.002s
I20260807 15:08:11.486972 28569 tablet_bootstrap.cc:492] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:11.487459 28578 raft_consensus.cc:482] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.487844 28576 raft_consensus.cc:482] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:08:11.488780 28332 leader_election.cc:341] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.488596 28576 raft_consensus.cc:504] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.488467 28578 raft_consensus.cc:504] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.489650 28569 ts_tablet_manager.cc:1397] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.082s user 0.020s sys 0.023s
I20260807 15:08:11.489493 28332 leader_election.cc:302] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:11.486653 28572 tablet_bootstrap.cc:492] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
I20260807 15:08:11.493891 28578 leader_election.cc:288] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:11.496016 28578 raft_consensus.cc:2726] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:11.496593 28576 leader_election.cc:288] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.500162 28576 raft_consensus.cc:482] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.502836 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:11.504549 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:11.501251 28576 raft_consensus.cc:504] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
W20260807 15:08:11.512418 28484 leader_election.cc:341] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.510558 28576 leader_election.cc:288] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.504571 28446 raft_consensus.cc:2454] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 0.
I20260807 15:08:11.518062 28571 tablet_bootstrap.cc:492] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:11.517741 28331 leader_election.cc:302] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:11.519132 28578 raft_consensus.cc:2781] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:11.519487 28578 raft_consensus.cc:482] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:11.515992 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:11.519944 28578 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.526473 28571 ts_tablet_manager.cc:1397] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.104s user 0.013s sys 0.020s
I20260807 15:08:11.520450 28445 raft_consensus.cc:2454] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 0.
I20260807 15:08:11.528167 28569 raft_consensus.cc:348] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:11.532189 28569 raft_consensus.cc:374] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.542197 28569 raft_consensus.cc:729] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.542444 28484 leader_election.cc:302] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
I20260807 15:08:11.544041 28576 raft_consensus.cc:2781] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:11.545647 28576 raft_consensus.cc:482] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:11.546051 28576 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.544647 28569 consensus_queue.cc:260] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:11.553572 28578 raft_consensus.cc:504] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
W20260807 15:08:11.548066 28332 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:39771, user_credentials={real_user=slave}} blocked reactor thread for 59988.9us
I20260807 15:08:11.558630 28572 tablet_bootstrap.cc:654] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.553876 28569 ts_tablet_manager.cc:1428] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.064s user 0.010s sys 0.004s
I20260807 15:08:11.566702 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:11.567080 28578 leader_election.cc:288] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 election: Requested vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:11.567492 28569 tablet_bootstrap.cc:492] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:11.561887 28576 raft_consensus.cc:504] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.569674 28523 raft_consensus.cc:2379] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5144217a8a5443aa8a00f8d60cfd9b60 in current term 1: Already voted for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in this term.
I20260807 15:08:11.569546 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:11.570400 28445 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.570739 28576 leader_election.cc:288] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.575825 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:11.578572 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.579591 28370 raft_consensus.cc:2454] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 0.
I20260807 15:08:11.587393 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.586758 28571 raft_consensus.cc:348] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.588912 28571 raft_consensus.cc:374] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.589556 28571 raft_consensus.cc:729] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.590567 28445 raft_consensus.cc:2454] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 1.
I20260807 15:08:11.591192 28571 consensus_queue.cc:260] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.592826 28370 raft_consensus.cc:2379] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in current term 1: Already voted for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in this term.
I20260807 15:08:11.593071 28331 leader_election.cc:302] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:11.594439 28578 raft_consensus.cc:2781] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:11.596359 28578 raft_consensus.cc:686] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 LEADER]: Becoming Leader. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:11.598106 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:11.601025 28485 leader_election.cc:302] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:11.601213 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:11.602622 28576 raft_consensus.cc:2781] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:11.603291 28523 raft_consensus.cc:2379] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5144217a8a5443aa8a00f8d60cfd9b60 in current term 1: Already voted for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in this term.
I20260807 15:08:11.603256 28576 raft_consensus.cc:482] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:11.604068 28576 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.606189 28571 ts_tablet_manager.cc:1428] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.065s user 0.008s sys 0.005s
I20260807 15:08:11.607591 28571 tablet_bootstrap.cc:492] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:11.601637 28578 consensus_queue.cc:237] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.613510 28572 tablet_bootstrap.cc:492] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:11.614205 28572 ts_tablet_manager.cc:1397] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.128s user 0.016s sys 0.030s
I20260807 15:08:11.621865 28569 tablet_bootstrap.cc:654] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.622764 28576 raft_consensus.cc:504] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.628685 28485 leader_election.cc:302] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115; no voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:11.640403 28601 raft_consensus.cc:2726] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 15:08:11.649887 28576 leader_election.cc:288] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.651170 28600 raft_consensus.cc:482] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.651626 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:11.652876 28369 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.652241 28600 raft_consensus.cc:504] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:11.654181 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
W20260807 15:08:11.658368 28484 leader_election.cc:341] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.662032 28600 leader_election.cc:288] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.663244 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:11.664016 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
W20260807 15:08:11.665604 28332 leader_election.cc:341] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.659811 28571 tablet_bootstrap.cc:654] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
W20260807 15:08:11.666467 28331 leader_election.cc:341] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.667932 28331 leader_election.cc:302] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:11.672031 28569 tablet_bootstrap.cc:492] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:11.672632 28569 ts_tablet_manager.cc:1397] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.105s user 0.011s sys 0.015s
I20260807 15:08:11.670073 28600 raft_consensus.cc:2726] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:11.676568 28572 raft_consensus.cc:348] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.677145 28260 catalog_manager.cc:5495] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193). New cstate: current_term: 1 leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:11.679235 28572 raft_consensus.cc:374] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.679574 28572 raft_consensus.cc:729] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.680401 28572 consensus_queue.cc:260] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.682873 28572 ts_tablet_manager.cc:1428] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.068s user 0.009s sys 0.007s
I20260807 15:08:11.678830 28569 raft_consensus.cc:348] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.687135 28569 raft_consensus.cc:374] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.687647 28569 raft_consensus.cc:729] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.689774 28569 consensus_queue.cc:260] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.691960 28572 tablet_bootstrap.cc:492] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
I20260807 15:08:11.697104 28569 ts_tablet_manager.cc:1428] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.024s user 0.007s sys 0.004s
I20260807 15:08:11.699054 28569 tablet_bootstrap.cc:492] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:11.701413 28369 raft_consensus.cc:2454] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 1.
I20260807 15:08:11.703153 28485 leader_election.cc:302] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:11.704442 28601 raft_consensus.cc:2781] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:11.705380 28601 raft_consensus.cc:686] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Becoming Leader. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:11.707305 28601 consensus_queue.cc:237] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.712286 28576 raft_consensus.cc:482] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.713027 28576 raft_consensus.cc:504] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.720252 28576 leader_election.cc:288] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.721498 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:11.722703 28445 raft_consensus.cc:2454] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 0.
I20260807 15:08:11.725099 28484 leader_election.cc:302] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
I20260807 15:08:11.725772 28571 tablet_bootstrap.cc:492] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:11.729830 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.730223 28576 raft_consensus.cc:2781] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:11.730743 28576 raft_consensus.cc:482] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:11.731137 28576 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:08:11.731454 28485 leader_election.cc:341] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.733243 28571 ts_tablet_manager.cc:1397] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.126s user 0.026s sys 0.026s
I20260807 15:08:11.736230 28577 raft_consensus.cc:482] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.737025 28577 raft_consensus.cc:504] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.739552 28257 catalog_manager.cc:5495] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:11.741472 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
W20260807 15:08:11.742859 28410 leader_election.cc:341] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.740362 28577 leader_election.cc:288] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:11.745335 28572 tablet_bootstrap.cc:654] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.745818 28571 raft_consensus.cc:348] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.746543 28571 raft_consensus.cc:374] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.746850 28571 raft_consensus.cc:729] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.747628 28571 consensus_queue.cc:260] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.749223 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.750401 28369 raft_consensus.cc:2454] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 0.
I20260807 15:08:11.751822 28410 leader_election.cc:302] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 22175a41bb7b4ad6b4e0e55ce06c1115
I20260807 15:08:11.753079 28577 raft_consensus.cc:2781] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:11.753473 28577 raft_consensus.cc:482] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:11.749864 28576 raft_consensus.cc:504] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.753893 28577 raft_consensus.cc:3037] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.754554 28569 tablet_bootstrap.cc:654] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.761270 28576 leader_election.cc:288] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:11.762336 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:11.763042 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
W20260807 15:08:11.764074 28485 leader_election.cc:341] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.764111 28445 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.772276 28577 raft_consensus.cc:504] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.776934 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:11.777995 28369 raft_consensus.cc:3037] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.782972 28571 ts_tablet_manager.cc:1428] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.049s user 0.007s sys 0.000s
I20260807 15:08:11.784862 28571 tablet_bootstrap.cc:492] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:11.788069 28569 tablet_bootstrap.cc:492] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:11.788825 28569 ts_tablet_manager.cc:1397] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.090s user 0.015s sys 0.011s
I20260807 15:08:11.790359 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
W20260807 15:08:11.792268 28410 leader_election.cc:341] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:11.793313 28569 raft_consensus.cc:348] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.793948 28577 leader_election.cc:288] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:11.794365 28569 raft_consensus.cc:374] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.792369 28445 raft_consensus.cc:2454] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 1.
I20260807 15:08:11.820065 28369 raft_consensus.cc:2454] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 1.
I20260807 15:08:11.815785 28569 raft_consensus.cc:729] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.822091 28410 leader_election.cc:302] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 22175a41bb7b4ad6b4e0e55ce06c1115
I20260807 15:08:11.823052 28577 raft_consensus.cc:2781] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:11.822124 28484 leader_election.cc:302] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters: 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:11.824118 28576 raft_consensus.cc:2781] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:11.824577 28576 raft_consensus.cc:686] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Becoming Leader. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:11.825398 28576 consensus_queue.cc:237] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.828133 28577 raft_consensus.cc:686] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:11.829186 28577 consensus_queue.cc:237] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.830297 28569 consensus_queue.cc:260] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.833391 28572 tablet_bootstrap.cc:492] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:11.834105 28572 ts_tablet_manager.cc:1397] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.142s user 0.012s sys 0.031s
I20260807 15:08:11.836206 28569 ts_tablet_manager.cc:1428] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.047s user 0.010s sys 0.002s
I20260807 15:08:11.841114 28569 tablet_bootstrap.cc:492] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:11.856398 28572 raft_consensus.cc:348] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:11.857874 28572 raft_consensus.cc:374] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.858315 28572 raft_consensus.cc:729] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.873750 28572 consensus_queue.cc:260] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:11.882130 28572 ts_tablet_manager.cc:1428] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.048s user 0.006s sys 0.007s
I20260807 15:08:11.884460 28572 tablet_bootstrap.cc:492] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
I20260807 15:08:11.890694 28611 raft_consensus.cc:482] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.891793 28611 raft_consensus.cc:504] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.896157 28571 tablet_bootstrap.cc:654] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.897840 28611 leader_election.cc:288] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:11.898681 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.900254 28369 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 0.
I20260807 15:08:11.900732 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:11.901979 28523 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 0.
I20260807 15:08:11.902485 28410 leader_election.cc:302] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:11.906180 28611 raft_consensus.cc:2781] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:11.906893 28611 raft_consensus.cc:482] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:11.907639 28611 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.923641 28261 catalog_manager.cc:5495] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 1 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:11.924876 28257 catalog_manager.cc:5495] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:11.932580 28571 tablet_bootstrap.cc:492] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:11.933172 28571 ts_tablet_manager.cc:1397] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.149s user 0.008s sys 0.024s
I20260807 15:08:11.935487 28569 tablet_bootstrap.cc:654] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.938659 28571 raft_consensus.cc:348] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.939535 28571 raft_consensus.cc:374] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:11.939465 28611 raft_consensus.cc:504] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.940043 28571 raft_consensus.cc:729] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:11.943962 28572 tablet_bootstrap.cc:654] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:11.941052 28571 consensus_queue.cc:260] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:11.946697 28571 ts_tablet_manager.cc:1428] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.013s user 0.006s sys 0.003s
I20260807 15:08:11.954294 28571 tablet_bootstrap.cc:492] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:11.975018 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:11.976107 28369 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.976500 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:11.977468 28523 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:11.980659 28611 leader_election.cc:288] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:11.984548 28576 raft_consensus.cc:482] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:11.985350 28576 raft_consensus.cc:504] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:11.990772 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:11.994421 28370 raft_consensus.cc:2454] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 0.
I20260807 15:08:11.997984 28485 leader_election.cc:302] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:11.999650 28576 leader_election.cc:288] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:12.000074 28601 raft_consensus.cc:2781] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:12.000720 28601 raft_consensus.cc:482] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:12.001214 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
W20260807 15:08:12.003343 28484 leader_election.cc:341] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:12.001338 28601 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.014886 28569 tablet_bootstrap.cc:492] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:12.016474 28569 ts_tablet_manager.cc:1397] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.177s user 0.021s sys 0.024s
I20260807 15:08:12.015523 28571 tablet_bootstrap.cc:654] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:12.025177 28523 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 1.
I20260807 15:08:12.028143 28410 leader_election.cc:302] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
I20260807 15:08:12.026648 28601 raft_consensus.cc:504] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:12.030064 28611 raft_consensus.cc:2781] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:12.031090 28611 raft_consensus.cc:686] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:12.032954 28611 consensus_queue.cc:237] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.035562 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:12.036934 28370 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.038900 28601 leader_election.cc:288] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:12.040736 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:12.042825 28569 raft_consensus.cc:348] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
W20260807 15:08:12.043478 28484 leader_election.cc:341] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:12.044179 28569 raft_consensus.cc:374] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.044911 28569 raft_consensus.cc:729] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.046183 28569 consensus_queue.cc:260] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.027590 28572 tablet_bootstrap.cc:492] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:12.032487 28369 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 1.
I20260807 15:08:12.049504 28572 ts_tablet_manager.cc:1397] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.165s user 0.029s sys 0.037s
I20260807 15:08:12.057384 28370 raft_consensus.cc:2454] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 1.
I20260807 15:08:12.058808 28485 leader_election.cc:302] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:12.060171 28601 raft_consensus.cc:2781] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:12.060648 28601 raft_consensus.cc:686] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Becoming Leader. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:12.061470 28601 consensus_queue.cc:237] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:12.070676 28572 raft_consensus.cc:348] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.071496 28572 raft_consensus.cc:374] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.071795 28572 raft_consensus.cc:729] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.070885 28261 catalog_manager.cc:5495] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 1 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:12.069868 28569 ts_tablet_manager.cc:1428] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.049s user 0.004s sys 0.009s
I20260807 15:08:12.076646 28571 tablet_bootstrap.cc:492] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:12.072593 28572 consensus_queue.cc:260] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.077589 28571 ts_tablet_manager.cc:1397] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.124s user 0.014s sys 0.029s
I20260807 15:08:12.080153 28569 tablet_bootstrap.cc:492] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:12.084697 28572 ts_tablet_manager.cc:1428] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.035s user 0.011s sys 0.004s
I20260807 15:08:12.086843 28572 tablet_bootstrap.cc:492] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
I20260807 15:08:12.105042 28611 raft_consensus.cc:482] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:12.105587 28611 raft_consensus.cc:504] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.108147 28611 leader_election.cc:288] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:12.107419 28260 catalog_manager.cc:5495] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:12.110387 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:12.110540 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:12.111125 28370 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 0.
I20260807 15:08:12.111632 28523 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 0.
I20260807 15:08:12.107453 28600 consensus_queue.cc:1035] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260807 15:08:12.112922 28410 leader_election.cc:302] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:12.112905 28571 raft_consensus.cc:348] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.114770 28571 raft_consensus.cc:374] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.115420 28611 raft_consensus.cc:2781] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:12.115819 28611 raft_consensus.cc:482] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:12.115468 28571 raft_consensus.cc:729] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.116266 28611 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.120275 28569 tablet_bootstrap.cc:654] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:12.121765 28571 consensus_queue.cc:260] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.137315 28571 ts_tablet_manager.cc:1428] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.059s user 0.011s sys 0.010s
I20260807 15:08:12.138481 28572 tablet_bootstrap.cc:654] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:12.143431 28600 raft_consensus.cc:482] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:12.145073 28600 raft_consensus.cc:504] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.149497 28600 leader_election.cc:288] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:12.150324 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:12.151672 28445 raft_consensus.cc:2379] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5144217a8a5443aa8a00f8d60cfd9b60 in current term 1: Already voted for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in this term.
I20260807 15:08:12.152434 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:12.153650 28611 raft_consensus.cc:504] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.155562 28332 leader_election.cc:302] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:12.158185 28577 raft_consensus.cc:482] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:12.158854 28577 raft_consensus.cc:504] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.159657 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:12.160270 28600 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.160624 28370 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.163406 28577 leader_election.cc:288] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:12.167551 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3592f94a979c481a8982c6aba50daf12" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:12.170985 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3592f94a979c481a8982c6aba50daf12" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:12.171392 28522 raft_consensus.cc:2454] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 0.
I20260807 15:08:12.178150 28410 leader_election.cc:302] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
W20260807 15:08:12.180905 28410 leader_election.cc:341] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:12.188529 28571 tablet_bootstrap.cc:492] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:12.189517 28577 raft_consensus.cc:2781] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:12.194182 28577 raft_consensus.cc:482] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:12.195401 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:12.196605 28522 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.200596 28370 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 1.
I20260807 15:08:12.188958 28611 leader_election.cc:288] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:12.194788 28577 raft_consensus.cc:3037] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.207587 28600 raft_consensus.cc:2726] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:12.214267 28410 leader_election.cc:302] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:12.214802 28522 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 1.
I20260807 15:08:12.219394 28611 raft_consensus.cc:2781] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:12.224278 28611 raft_consensus.cc:686] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:12.233359 28569 tablet_bootstrap.cc:492] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:12.234404 28569 ts_tablet_manager.cc:1397] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.155s user 0.030s sys 0.023s
I20260807 15:08:12.238581 28628 consensus_queue.cc:1035] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 15:08:12.236335 28611 consensus_queue.cc:237] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.244352 28577 raft_consensus.cc:504] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
W20260807 15:08:12.256305 28484 consensus_peers.cc:487] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 -> Peer 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375): Couldn't send request to peer 35da3a06e22848089a706c5ed81cc90c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:08:12.281862 28569 raft_consensus.cc:348] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.283017 28569 raft_consensus.cc:374] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.283349 28569 raft_consensus.cc:729] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.286310 28572 tablet_bootstrap.cc:492] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:12.287092 28572 ts_tablet_manager.cc:1397] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.201s user 0.014s sys 0.023s
I20260807 15:08:12.286780 28569 consensus_queue.cc:260] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.290864 28577 leader_election.cc:288] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:12.292336 28569 ts_tablet_manager.cc:1428] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.057s user 0.006s sys 0.009s
W20260807 15:08:12.265789 28332 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:39771, user_credentials={real_user=slave}} blocked reactor thread for 62593.1us
I20260807 15:08:12.294061 28569 tablet_bootstrap.cc:492] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60: Bootstrap starting.
I20260807 15:08:12.313534 28571 tablet_bootstrap.cc:654] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:12.321995 28572 raft_consensus.cc:348] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.323323 28572 raft_consensus.cc:374] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.323733 28572 raft_consensus.cc:729] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.324645 28572 consensus_queue.cc:260] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.328404 28572 ts_tablet_manager.cc:1428] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.041s user 0.011s sys 0.006s
I20260807 15:08:12.332657 28572 tablet_bootstrap.cc:492] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115: Bootstrap starting.
I20260807 15:08:12.334072 28601 consensus_queue.cc:1035] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 15:08:12.335492 28576 consensus_queue.cc:1035] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:12.364332 28572 tablet_bootstrap.cc:654] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:12.370450 28576 raft_consensus.cc:482] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:12.375036 28576 raft_consensus.cc:504] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.397337 28569 tablet_bootstrap.cc:654] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:12.402587 28367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3592f94a979c481a8982c6aba50daf12" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:12.393566 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3592f94a979c481a8982c6aba50daf12" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:12.413874 28632 raft_consensus.cc:482] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:12.417392 28601 consensus_queue.cc:1035] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:12.414937 28632 raft_consensus.cc:504] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.419291 28523 raft_consensus.cc:3037] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.430576 28576 leader_election.cc:288] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:12.434890 28257 catalog_manager.cc:5495] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 1 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
W20260807 15:08:12.421916 28410 consensus_peers.cc:487] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c -> Peer 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771): Couldn't send request to peer 22175a41bb7b4ad6b4e0e55ce06c1115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:08:12.441359 28632 leader_election.cc:288] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:12.448985 28368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:12.449355 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:12.450224 28368 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 0.
I20260807 15:08:12.450362 28446 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 0.
I20260807 15:08:12.452382 28485 leader_election.cc:302] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:12.449523 28367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:12.456776 28367 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 0.
I20260807 15:08:12.457736 28576 raft_consensus.cc:2781] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:12.458220 28576 raft_consensus.cc:482] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:12.458643 28576 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:08:12.463704 28410 leader_election.cc:341] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:12.472150 28571 tablet_bootstrap.cc:492] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:12.472357 28632 consensus_queue.cc:1035] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 15:08:12.475023 28571 ts_tablet_manager.cc:1397] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.331s user 0.004s sys 0.044s
I20260807 15:08:12.467694 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:12.478897 28410 leader_election.cc:302] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:12.495620 28632 raft_consensus.cc:2781] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:12.496263 28632 raft_consensus.cc:482] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:12.496771 28632 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.494958 28571 raft_consensus.cc:348] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:12.500560 28571 raft_consensus.cc:374] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.500847 28571 raft_consensus.cc:729] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.501506 28571 consensus_queue.cc:260] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:12.506878 28576 raft_consensus.cc:504] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.508973 28522 raft_consensus.cc:2379] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35da3a06e22848089a706c5ed81cc90c in current term 1: Already voted for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in this term.
I20260807 15:08:12.510169 28571 ts_tablet_manager.cc:1428] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.035s user 0.004s sys 0.005s
I20260807 15:08:12.508989 28523 raft_consensus.cc:2454] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 1.
I20260807 15:08:12.514638 28576 leader_election.cc:288] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:12.520152 28571 tablet_bootstrap.cc:492] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c: Bootstrap starting.
I20260807 15:08:12.520215 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
W20260807 15:08:12.527667 28311 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:08:12.551753 28611 consensus_queue.cc:1035] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:12.555703 28632 raft_consensus.cc:504] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.586369 28446 raft_consensus.cc:2379] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in current term 1: Already voted for candidate 35da3a06e22848089a706c5ed81cc90c in this term.
I20260807 15:08:12.594005 28571 tablet_bootstrap.cc:654] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:12.595799 28572 tablet_bootstrap.cc:492] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115: No bootstrap required, opened a new log
I20260807 15:08:12.596565 28572 ts_tablet_manager.cc:1397] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent bootstrapping tablet: real 0.264s user 0.013s sys 0.025s
I20260807 15:08:12.614866 28632 leader_election.cc:288] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:12.618170 28572 raft_consensus.cc:348] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.623261 28572 raft_consensus.cc:374] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.623674 28572 raft_consensus.cc:729] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.622637 28367 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:12.626062 28572 consensus_queue.cc:260] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
W20260807 15:08:12.625546 28485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:38507, user_credentials={real_user=slave}} blocked reactor thread for 132622us
I20260807 15:08:12.641919 28367 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.664412 28569 tablet_bootstrap.cc:492] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60: No bootstrap required, opened a new log
I20260807 15:08:12.665035 28569 ts_tablet_manager.cc:1397] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent bootstrapping tablet: real 0.371s user 0.023s sys 0.023s
I20260807 15:08:12.669142 28410 leader_election.cc:302] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters: 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:12.655076 28632 consensus_queue.cc:1035] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260807 15:08:12.674638 28629 raft_consensus.cc:2781] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:12.676601 28368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:12.675644 28629 raft_consensus.cc:686] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:12.688032 28445 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.704823 28569 raft_consensus.cc:348] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.705891 28569 raft_consensus.cc:374] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.706241 28569 raft_consensus.cc:729] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.708248 28569 consensus_queue.cc:260] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.693846 28485 leader_election.cc:302] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115; no voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:12.717011 28632 consensus_queue.cc:1035] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 15:08:12.722280 28629 consensus_queue.cc:237] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.729689 28569 ts_tablet_manager.cc:1428] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60: Time spent starting tablet: real 0.064s user 0.008s sys 0.004s
I20260807 15:08:12.729980 28572 ts_tablet_manager.cc:1428] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115: Time spent starting tablet: real 0.133s user 0.033s sys 0.009s
I20260807 15:08:12.733634 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:12.757154 28644 raft_consensus.cc:2726] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 15:08:12.759047 28523 raft_consensus.cc:2379] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35da3a06e22848089a706c5ed81cc90c in current term 1: Already voted for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in this term.
I20260807 15:08:12.826457 28571 tablet_bootstrap.cc:492] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c: No bootstrap required, opened a new log
I20260807 15:08:12.827198 28571 ts_tablet_manager.cc:1397] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c: Time spent bootstrapping tablet: real 0.307s user 0.015s sys 0.017s
I20260807 15:08:12.837642 28649 raft_consensus.cc:482] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:12.823542 28367 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 1.
I20260807 15:08:12.838698 28649 raft_consensus.cc:504] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.840530 28643 consensus_queue.cc:1035] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.113s
I20260807 15:08:12.882512 28649 leader_election.cc:288] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:12.875659 28644 consensus_queue.cc:1035] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:12.883976 28571 raft_consensus.cc:348] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.892560 28571 raft_consensus.cc:374] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:12.892904 28571 raft_consensus.cc:729] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Initialized, Role: FOLLOWER
I20260807 15:08:12.893690 28571 consensus_queue.cc:260] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.900792 28261 catalog_manager.cc:5495] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 1 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:12.906054 28571 ts_tablet_manager.cc:1428] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c: Time spent starting tablet: real 0.078s user 0.011s sys 0.006s
I20260807 15:08:12.903306 28370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:12.908959 28445 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:12.921679 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:12.945613 28484 leader_election.cc:302] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115; no voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:12.948060 28648 raft_consensus.cc:2726] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:12.949234 28600 raft_consensus.cc:482] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:12.949965 28600 raft_consensus.cc:504] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:12.955413 28410 leader_election.cc:302] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:12.957691 28600 leader_election.cc:288] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:12.960086 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3592f94a979c481a8982c6aba50daf12" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:12.968488 28629 raft_consensus.cc:2781] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:12.996419 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3592f94a979c481a8982c6aba50daf12" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" is_pre_election: true
I20260807 15:08:13.015327 28522 raft_consensus.cc:2379] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5144217a8a5443aa8a00f8d60cfd9b60 in current term 1: Already voted for candidate 35da3a06e22848089a706c5ed81cc90c in this term.
I20260807 15:08:13.025209 28332 leader_election.cc:302] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5144217a8a5443aa8a00f8d60cfd9b60; no voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:13.032478 28600 raft_consensus.cc:3037] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:13.037302 28629 raft_consensus.cc:686] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:13.068935 28629 consensus_queue.cc:237] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.071651 28600 raft_consensus.cc:2726] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 15:08:13.073470 28410 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:38507, user_credentials={real_user=slave}} blocked reactor thread for 88665.8us
I20260807 15:08:13.085050 28660 consensus_queue.cc:1035] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 15:08:13.138321 28523 raft_consensus.cc:3037] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:13.179005 28260 catalog_manager.cc:5495] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 1 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:13.190603 28629 consensus_queue.cc:1035] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:13.217975 28629 consensus_queue.cc:1035] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:13.289206 28523 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
mode: GRACEFUL
new_leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:54414
I20260807 15:08:13.290298 28523 raft_consensus.cc:595] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Received request to transfer leadership to TS 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:13.326355 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:49144
I20260807 15:08:13.327349 28445 raft_consensus.cc:595] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Received request to transfer leadership to TS 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:13.335598 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "64d0088290624819a603685d23665f50"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:49144
I20260807 15:08:13.336602 28445 raft_consensus.cc:595] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Received request to transfer leadership to TS 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:13.344954 28523 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
mode: GRACEFUL
new_leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:54414
I20260807 15:08:13.345739 28523 raft_consensus.cc:595] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Received request to transfer leadership to TS 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:13.379837 28369 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
mode: GRACEFUL
new_leader_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:34106
I20260807 15:08:13.380630 28369 raft_consensus.cc:595] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 LEADER]: Received request to transfer leadership to TS 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:13.393587 28523 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
mode: GRACEFUL
new_leader_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:54414
I20260807 15:08:13.394330 28523 raft_consensus.cc:595] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Received request to transfer leadership to TS 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:13.403740 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:49144
I20260807 15:08:13.404538 28445 raft_consensus.cc:595] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Received request to transfer leadership to TS 22175a41bb7b4ad6b4e0e55ce06c1115
I20260807 15:08:13.443717 28611 raft_consensus.cc:979] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:13.444499 28629 raft_consensus.cc:1067] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Signalling peer 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:13.446450 28369 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:51718
I20260807 15:08:13.447288 28369 raft_consensus.cc:482] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:13.447638 28369 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.454293 28369 raft_consensus.cc:504] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.456919 28369 leader_election.cc:288] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 2 election: Requested vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:13.458387 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:13.459057 28523 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.460599 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:13.461606 28445 raft_consensus.cc:3032] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:13.462020 28445 raft_consensus.cc:729] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:13.462842 28445 consensus_queue.cc:260] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.464378 28445 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.468909 28523 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 2.
I20260807 15:08:13.470749 28332 leader_election.cc:302] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:13.472276 28600 raft_consensus.cc:2781] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:13.473933 28600 raft_consensus.cc:686] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Becoming Leader. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:13.474057 28445 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 2.
I20260807 15:08:13.476255 28600 consensus_queue.cc:237] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.491437 28260 catalog_manager.cc:5495] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 reported cstate change: term changed from 1 to 2, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193). New cstate: current_term: 2 leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:13.526930 28643 raft_consensus.cc:979] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115: : Instructing follower 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:13.527647 28648 raft_consensus.cc:1067] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Signalling peer 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:13.530031 28369 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:51724
I20260807 15:08:13.530733 28369 raft_consensus.cc:482] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:13.531239 28369 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.538300 28369 raft_consensus.cc:504] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.543946 28369 leader_election.cc:288] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 2 election: Requested vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:13.544142 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:13.544864 28523 raft_consensus.cc:3032] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:13.545203 28523 raft_consensus.cc:729] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:13.544703 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:13.545895 28445 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.545946 28523 consensus_queue.cc:260] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.547349 28523 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.556972 28445 raft_consensus.cc:2454] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 2.
I20260807 15:08:13.558787 28331 leader_election.cc:302] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:13.560316 28600 raft_consensus.cc:2781] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:13.561045 28600 raft_consensus.cc:686] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Becoming Leader. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:13.562268 28600 consensus_queue.cc:237] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.566021 28648 raft_consensus.cc:979] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115: : Instructing follower 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:13.566608 28648 raft_consensus.cc:1067] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Signalling peer 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:13.568301 28629 consensus_queue.cc:1035] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:13.568948 28365 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:51724
I20260807 15:08:13.569770 28365 raft_consensus.cc:482] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:13.570361 28365 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.556581 28523 raft_consensus.cc:2454] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 2.
I20260807 15:08:13.580787 28260 catalog_manager.cc:5495] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 reported cstate change: term changed from 1 to 2, leader changed from 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195) to 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193). New cstate: current_term: 2 leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:13.588459 28365 raft_consensus.cc:504] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:13.598351 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:13.598825 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:13.599038 28445 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.599427 28522 raft_consensus.cc:3032] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:13.605746 28659 consensus_queue.cc:1035] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:13.599759 28522 raft_consensus.cc:729] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:13.607717 28522 consensus_queue.cc:260] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:13.611248 28522 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.613554 28445 raft_consensus.cc:2454] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 2.
I20260807 15:08:13.611693 28365 leader_election.cc:288] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 2 election: Requested vote from peers 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:13.614845 28331 leader_election.cc:302] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:13.615725 28600 raft_consensus.cc:2781] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:13.616220 28600 raft_consensus.cc:686] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Becoming Leader. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:13.617048 28600 consensus_queue.cc:237] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:13.630041 28522 raft_consensus.cc:2454] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 2.
I20260807 15:08:13.640107 28260 catalog_manager.cc:5495] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 reported cstate change: term changed from 1 to 2, leader changed from 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195) to 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193). New cstate: current_term: 2 leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:13.662978 28659 raft_consensus.cc:979] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:13.663488 28659 raft_consensus.cc:1067] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Signalling peer 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:13.666450 28522 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:35552
I20260807 15:08:13.667127 28522 raft_consensus.cc:482] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:13.667542 28522 raft_consensus.cc:3037] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.672472 28522 raft_consensus.cc:504] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.674491 28522 leader_election.cc:288] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 2 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:13.674971 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:13.675177 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d025293a4e9740599a19750cb0ae98d3" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:13.675619 28369 raft_consensus.cc:3037] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.675829 28445 raft_consensus.cc:3032] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:13.676246 28445 raft_consensus.cc:729] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:13.677062 28445 consensus_queue.cc:260] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.678004 28445 raft_consensus.cc:3037] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.682539 28445 raft_consensus.cc:2454] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 2.
I20260807 15:08:13.682972 28369 raft_consensus.cc:2454] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 2.
I20260807 15:08:13.683590 28484 leader_election.cc:302] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
I20260807 15:08:13.684445 28648 raft_consensus.cc:2781] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:13.684964 28648 raft_consensus.cc:686] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 LEADER]: Becoming Leader. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:13.685703 28648 consensus_queue.cc:237] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.692168 28659 raft_consensus.cc:979] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:13.692656 28629 raft_consensus.cc:1067] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Signalling peer 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:13.693114 28260 catalog_manager.cc:5495] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 reported cstate change: term changed from 1 to 2, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:13.694254 28369 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "64d0088290624819a603685d23665f50"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:51718
I20260807 15:08:13.694818 28369 raft_consensus.cc:482] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:13.695194 28369 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.705034 28369 raft_consensus.cc:504] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.707923 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:13.708160 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:13.708631 28445 raft_consensus.cc:3032] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:13.708734 28522 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.709056 28445 raft_consensus.cc:729] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:13.709897 28445 consensus_queue.cc:260] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.711211 28445 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.716054 28369 leader_election.cc:288] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 2 election: Requested vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:13.716410 28522 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 2.
I20260807 15:08:13.717684 28332 leader_election.cc:302] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:13.718561 28600 raft_consensus.cc:2781] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:13.719055 28600 raft_consensus.cc:686] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Becoming Leader. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:13.719413 28445 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 2.
I20260807 15:08:13.719923 28600 consensus_queue.cc:237] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.727880 28260 catalog_manager.cc:5495] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 reported cstate change: term changed from 1 to 2, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193). New cstate: current_term: 2 leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:13.797331 28674 raft_consensus.cc:979] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60: : Instructing follower 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:13.797782 28600 raft_consensus.cc:1067] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 LEADER]: Signalling peer 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:13.799441 28445 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:38710
I20260807 15:08:13.800038 28445 raft_consensus.cc:482] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:13.800381 28445 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.805567 28445 raft_consensus.cc:504] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.807451 28445 leader_election.cc:288] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 2 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:13.808495 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:13.808995 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:13.809129 28369 raft_consensus.cc:3032] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:13.809581 28522 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.809548 28369 raft_consensus.cc:729] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:13.810547 28369 consensus_queue.cc:260] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.811831 28369 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.816599 28522 raft_consensus.cc:2454] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 2.
I20260807 15:08:13.817853 28410 leader_election.cc:302] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
I20260807 15:08:13.818756 28629 raft_consensus.cc:2781] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:13.818812 28369 raft_consensus.cc:2454] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 2.
I20260807 15:08:13.819350 28629 raft_consensus.cc:686] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:13.820888 28629 consensus_queue.cc:237] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.829357 28260 catalog_manager.cc:5495] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 1 to 2, leader changed from 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193) to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 2 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:13.851083 28643 raft_consensus.cc:979] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115: : Instructing follower 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:13.851610 28648 raft_consensus.cc:1067] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Signalling peer 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:13.853267 28445 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:38696
I20260807 15:08:13.853842 28445 raft_consensus.cc:482] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:13.854167 28445 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.859555 28445 raft_consensus.cc:504] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.861446 28445 leader_election.cc:288] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 2 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:13.862331 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:13.862627 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:13.862968 28369 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.863243 28522 raft_consensus.cc:3032] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:13.863606 28522 raft_consensus.cc:729] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:13.864379 28522 consensus_queue.cc:260] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.865690 28522 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:13.871239 28369 raft_consensus.cc:2454] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 2.
I20260807 15:08:13.872851 28522 raft_consensus.cc:2454] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 2.
I20260807 15:08:13.872895 28410 leader_election.cc:302] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:13.874241 28629 raft_consensus.cc:2781] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:13.874780 28629 raft_consensus.cc:686] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:13.876287 28629 consensus_queue.cc:237] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:13.887583 28260 catalog_manager.cc:5495] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 1 to 2, leader changed from 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195) to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 2 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:14.034619 28445 raft_consensus.cc:1261] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.036003 28600 consensus_queue.cc:1035] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:14.045892 28445 raft_consensus.cc:1261] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.049360 28600 consensus_queue.cc:1035] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:14.051362 28522 raft_consensus.cc:1261] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.054133 28681 consensus_queue.cc:1035] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:14.066257 28522 raft_consensus.cc:1261] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.069595 28681 consensus_queue.cc:1035] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:14.117527 28522 raft_consensus.cc:1261] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.118829 28681 consensus_queue.cc:1035] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:14.121979 28445 raft_consensus.cc:1261] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.123391 28681 consensus_queue.cc:1035] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:14.129273 28444 raft_consensus.cc:1261] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.130743 28600 consensus_queue.cc:1035] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:14.135699 28522 raft_consensus.cc:1261] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.145547 28681 consensus_queue.cc:1035] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:14.181784 28445 raft_consensus.cc:1261] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.183459 28648 consensus_queue.cc:1035] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:14.198238 28369 raft_consensus.cc:1261] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.200500 28648 consensus_queue.cc:1035] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:14.308337 28369 raft_consensus.cc:1261] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.309620 28611 consensus_queue.cc:1035] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:14.320645 28522 raft_consensus.cc:1261] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.323583 28629 consensus_queue.cc:1035] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:14.335165 28369 raft_consensus.cc:1261] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.336962 28629 consensus_queue.cc:1035] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:14.349630 28522 raft_consensus.cc:1261] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:14.351533 28659 consensus_queue.cc:1035] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:16.434826 28227 auto_leader_rebalancer-test.cc:269] The leader distribution is
I20260807 15:08:16.435803 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:16.454916 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:49156
I20260807 15:08:16.455377 28445 raft_consensus.cc:595] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Received request to transfer leadership to TS 22175a41bb7b4ad6b4e0e55ce06c1115
I20260807 15:08:16.472944 28369 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
mode: GRACEFUL
new_leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:34112
I20260807 15:08:16.473706 28369 raft_consensus.cc:595] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Received request to transfer leadership to TS 22175a41bb7b4ad6b4e0e55ce06c1115
I20260807 15:08:16.475205 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 15:08:16.475849 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:16.601223 28698 raft_consensus.cc:979] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60: : Instructing follower 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:16.602154 28600 raft_consensus.cc:1067] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Signalling peer 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:16.604734 28522 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:35558
I20260807 15:08:16.605547 28522 raft_consensus.cc:482] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:16.605896 28522 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:16.608865 28702 raft_consensus.cc:979] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:16.609508 28611 raft_consensus.cc:1067] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Signalling peer 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:16.612071 28523 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:35552
I20260807 15:08:16.612731 28523 raft_consensus.cc:482] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:16.613128 28523 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:16.617741 28523 raft_consensus.cc:504] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:16.617717 28522 raft_consensus.cc:504] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:16.621140 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:16.621946 28369 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:16.622354 28522 leader_election.cc:288] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 3 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:16.624917 28523 leader_election.cc:288] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 2 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:16.626327 28444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:16.627180 28444 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:16.627189 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:16.630227 28365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:16.633095 28365 raft_consensus.cc:3032] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:16.633714 28365 raft_consensus.cc:729] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:16.631105 28446 raft_consensus.cc:3032] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:16.636245 28446 raft_consensus.cc:729] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:16.637888 28446 consensus_queue.cc:260] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:16.638970 28369 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 2.
I20260807 15:08:16.634955 28365 consensus_queue.cc:260] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:16.640202 28446 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:16.641011 28485 leader_election.cc:302] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:16.641913 28444 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 3.
I20260807 15:08:16.642098 28365 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:16.642251 28697 raft_consensus.cc:2781] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:16.643811 28484 leader_election.cc:302] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
I20260807 15:08:16.648813 28697 raft_consensus.cc:686] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 LEADER]: Becoming Leader. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:16.650910 28697 consensus_queue.cc:237] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:16.654367 28365 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 3.
I20260807 15:08:16.656167 28703 raft_consensus.cc:2781] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:16.656896 28703 raft_consensus.cc:686] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 LEADER]: Becoming Leader. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:16.657975 28703 consensus_queue.cc:237] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:16.670357 28446 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 2.
I20260807 15:08:16.677568 28260 catalog_manager.cc:5495] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 reported cstate change: term changed from 1 to 2, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:16.701859 28260 catalog_manager.cc:5495] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 reported cstate change: term changed from 2 to 3, leader changed from 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193) to 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:17.062443 28446 raft_consensus.cc:1261] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:17.063884 28697 consensus_queue.cc:1035] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:17.076380 28365 raft_consensus.cc:1261] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:17.078606 28704 consensus_queue.cc:1035] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:08:17.135694 28365 raft_consensus.cc:1261] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:17.137435 28704 consensus_queue.cc:1035] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:17.145434 28446 raft_consensus.cc:1261] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:17.147763 28703 consensus_queue.cc:1035] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:17.476833 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:17.481766 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:17.482205 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:18.483311 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:18.488791 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:18.489357 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:19.574575 28703 raft_consensus.cc:482] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5144217a8a5443aa8a00f8d60cfd9b60)
I20260807 15:08:19.575690 28703 raft_consensus.cc:504] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:19.579540 28703 leader_election.cc:288] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:19.580833 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" is_pre_election: true
I20260807 15:08:19.589643 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35da3a06e22848089a706c5ed81cc90c" is_pre_election: true
I20260807 15:08:19.594074 28484 leader_election.cc:302] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115; no voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:19.596412 28723 raft_consensus.cc:2726] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:08:19.697527 28391 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea060 after lost signal to thread 28230
W20260807 15:08:19.698349 28391 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea740 after lost signal to thread 28298
W20260807 15:08:19.699124 28391 debug-util.cc:398] Leaking SignalData structure 0x7b08001f65a0 after lost signal to thread 28394
W20260807 15:08:19.699807 28391 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6de0 after lost signal to thread 28470
W20260807 15:08:19.700582 28391 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9180 after lost signal to thread 28547
I20260807 15:08:20.413997 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:20.422379 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:20.422983 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:21.423991 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:21.429286 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:21.429733 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:22.430632 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:22.435556 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:22.436080 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:23.436995 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:23.441740 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:23.442212 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:24.443136 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:24.448312 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:24.448859 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:25.449855 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:25.456300 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:25.456773 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:26.457665 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:26.462729 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:26.463201 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:27.505261 28227 auto_leader_rebalancer-test.cc:288] The leader distribution is
I20260807 15:08:27.512127 28365 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
mode: GRACEFUL
new_leader_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:34106
I20260807 15:08:27.513662 28365 raft_consensus.cc:595] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Received request to transfer leadership to TS 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:27.521155 28523 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
mode: GRACEFUL
new_leader_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:54414
I20260807 15:08:27.521929 28523 raft_consensus.cc:595] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 LEADER]: Received request to transfer leadership to TS 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:27.528451 28365 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "64d0088290624819a603685d23665f50"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
mode: GRACEFUL
new_leader_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:34106
I20260807 15:08:27.529153 28365 raft_consensus.cc:595] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Received request to transfer leadership to TS 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:27.536530 28365 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
mode: GRACEFUL
new_leader_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:34106
I20260807 15:08:27.537129 28365 raft_consensus.cc:595] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Received request to transfer leadership to TS 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:27.548522 28523 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
mode: GRACEFUL
new_leader_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:54414
I20260807 15:08:27.549077 28523 raft_consensus.cc:595] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 LEADER]: Received request to transfer leadership to TS 35da3a06e22848089a706c5ed81cc90c
I20260807 15:08:27.788575 28736 raft_consensus.cc:979] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60: : Instructing follower 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:27.789103 28722 raft_consensus.cc:1067] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Signalling peer 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:27.791060 28446 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:38710
I20260807 15:08:27.791719 28446 raft_consensus.cc:482] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:27.792340 28446 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.800312 28446 raft_consensus.cc:504] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:27.803269 28446 leader_election.cc:288] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 3 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:27.804376 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:27.804221 28365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:27.805056 28523 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.805434 28365 raft_consensus.cc:3032] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:27.805985 28365 raft_consensus.cc:729] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:27.807374 28365 consensus_queue.cc:260] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:27.811291 28523 raft_consensus.cc:2454] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 3.
I20260807 15:08:27.812063 28365 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.813581 28410 leader_election.cc:302] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
I20260807 15:08:27.814832 28733 raft_consensus.cc:2781] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:27.816411 28733 raft_consensus.cc:686] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:27.818090 28733 consensus_queue.cc:237] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:27.825169 28365 raft_consensus.cc:2454] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 3.
I20260807 15:08:27.831127 28259 catalog_manager.cc:5495] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 2 to 3, leader changed from 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193) to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 3 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:27.855069 28735 raft_consensus.cc:979] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115: : Instructing follower 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:27.855993 28728 raft_consensus.cc:1067] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 LEADER]: Signalling peer 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:27.858520 28446 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:38696
I20260807 15:08:27.859313 28446 raft_consensus.cc:482] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:27.859720 28446 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.868942 28446 raft_consensus.cc:504] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.870656 28446 leader_election.cc:288] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 3 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:27.872015 28365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:27.872764 28365 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.873082 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:27.873802 28523 raft_consensus.cc:3032] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:27.874209 28523 raft_consensus.cc:729] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:27.876150 28736 raft_consensus.cc:979] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60: : Instructing follower 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:27.875650 28523 consensus_queue.cc:260] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.876873 28722 raft_consensus.cc:1067] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Signalling peer 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:27.877928 28523 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.879757 28736 raft_consensus.cc:979] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60: : Instructing follower 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:27.880354 28736 raft_consensus.cc:1067] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Signalling peer 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:27.884173 28365 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 3.
I20260807 15:08:27.887014 28410 leader_election.cc:302] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:27.887331 28523 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 3.
I20260807 15:08:27.887486 28446 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:38710
I20260807 15:08:27.887568 28445 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "64d0088290624819a603685d23665f50"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:38710
I20260807 15:08:27.888340 28445 raft_consensus.cc:482] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:27.888374 28446 raft_consensus.cc:482] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:27.888947 28446 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.888756 28733 raft_consensus.cc:2781] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:27.888813 28445 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.889777 28733 raft_consensus.cc:686] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:27.891796 28733 consensus_queue.cc:237] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.894656 28446 raft_consensus.cc:504] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.896641 28446 leader_election.cc:288] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 3 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:27.897855 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:27.898484 28523 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.900439 28365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26236b6e40994f0f82e109182f76e32b" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:27.899471 28445 raft_consensus.cc:504] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.901365 28365 raft_consensus.cc:3032] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:27.901871 28365 raft_consensus.cc:729] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:27.903654 28445 leader_election.cc:288] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 3 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:27.903528 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:27.904248 28369 raft_consensus.cc:3032] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:27.903250 28365 consensus_queue.cc:260] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.904547 28369 raft_consensus.cc:729] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:27.905488 28365 raft_consensus.cc:3037] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.905437 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:27.905339 28369 consensus_queue.cc:260] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.906647 28522 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.907289 28369 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:27.911662 28523 raft_consensus.cc:2454] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 3.
I20260807 15:08:27.913228 28410 leader_election.cc:302] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 35da3a06e22848089a706c5ed81cc90c; no voters:
I20260807 15:08:27.914642 28737 raft_consensus.cc:2781] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:27.916788 28365 raft_consensus.cc:2454] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 3.
I20260807 15:08:27.920836 28369 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 3.
I20260807 15:08:27.921931 28737 raft_consensus.cc:686] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:27.922602 28410 leader_election.cc:302] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:27.924398 28745 raft_consensus.cc:2781] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:27.923482 28737 consensus_queue.cc:237] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.928260 28522 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 3.
I20260807 15:08:27.939415 28259 catalog_manager.cc:5495] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 2 to 3, leader changed from 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195) to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 3 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:27.940449 28745 raft_consensus.cc:686] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:27.942584 28745 consensus_queue.cc:237] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:27.960556 28259 catalog_manager.cc:5495] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 2 to 3, leader changed from 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193) to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 3 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:27.961771 28259 catalog_manager.cc:5495] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 2 to 3, leader changed from 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193) to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 3 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:28.093540 28735 raft_consensus.cc:979] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115: : Instructing follower 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:28.094400 28728 raft_consensus.cc:1067] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 LEADER]: Signalling peer 35da3a06e22848089a706c5ed81cc90c to start an election
I20260807 15:08:28.096295 28445 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
from {username='slave'} at 127.0.0.1:38696
I20260807 15:08:28.096931 28445 raft_consensus.cc:482] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:28.097272 28445 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:28.103472 28445 raft_consensus.cc:504] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:28.105374 28445 leader_election.cc:288] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 4 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:28.106597 28369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:28.106791 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d297f80ed4d4d889e91a1a04ca4fb6e" candidate_uuid: "35da3a06e22848089a706c5ed81cc90c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:28.107415 28369 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:28.107540 28522 raft_consensus.cc:3032] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:08:28.107999 28522 raft_consensus.cc:729] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:28.109066 28522 consensus_queue.cc:260] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:28.110441 28522 raft_consensus.cc:3037] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:28.113104 28369 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 4.
I20260807 15:08:28.115036 28410 leader_election.cc:302] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35da3a06e22848089a706c5ed81cc90c, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:28.116024 28737 raft_consensus.cc:2781] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:08:28.116520 28737 raft_consensus.cc:686] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 4 LEADER]: Becoming Leader. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:28.117719 28737 consensus_queue.cc:237] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:28.118410 28522 raft_consensus.cc:2454] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35da3a06e22848089a706c5ed81cc90c in term 4.
I20260807 15:08:28.129165 28259 catalog_manager.cc:5495] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c reported cstate change: term changed from 3 to 4, leader changed from 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195) to 35da3a06e22848089a706c5ed81cc90c (127.27.144.194). New cstate: current_term: 4 leader_uuid: "35da3a06e22848089a706c5ed81cc90c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:28.203760 28369 raft_consensus.cc:1261] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:28.205109 28737 consensus_queue.cc:1035] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:28.216833 28522 raft_consensus.cc:1261] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:28.219075 28737 consensus_queue.cc:1035] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:28.300153 28522 raft_consensus.cc:1261] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:28.301323 28737 consensus_queue.cc:1035] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:28.307861 28523 raft_consensus.cc:1261] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:28.310547 28737 consensus_queue.cc:1035] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:28.311973 28369 raft_consensus.cc:1261] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:28.313324 28737 consensus_queue.cc:1035] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:28.329066 28369 raft_consensus.cc:1261] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:28.330610 28746 consensus_queue.cc:1035] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:08:28.415824 28522 raft_consensus.cc:1261] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:28.417217 28746 consensus_queue.cc:1035] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:28.431528 28369 raft_consensus.cc:1261] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:28.432818 28737 consensus_queue.cc:1035] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:28.680698 28369 raft_consensus.cc:1261] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:28.681952 28737 consensus_queue.cc:1035] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:08:28.690928 28523 raft_consensus.cc:1261] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Refusing update from remote peer 35da3a06e22848089a706c5ed81cc90c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:28.693046 28737 consensus_queue.cc:1035] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:08:30.620504 28227 auto_leader_rebalancer-test.cc:303] The leader distribution is
I20260807 15:08:30.621181 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:30.627796 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:49156
I20260807 15:08:30.628465 28445 raft_consensus.cc:595] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Received request to transfer leadership to TS 22175a41bb7b4ad6b4e0e55ce06c1115
I20260807 15:08:30.631521 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:49156
I20260807 15:08:30.632140 28445 raft_consensus.cc:595] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Received request to transfer leadership to TS 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:30.634265 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "64d0088290624819a603685d23665f50"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:49156
I20260807 15:08:30.634690 28445 raft_consensus.cc:595] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Received request to transfer leadership to TS 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:30.636638 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:49156
I20260807 15:08:30.637046 28445 raft_consensus.cc:595] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Received request to transfer leadership to TS 5144217a8a5443aa8a00f8d60cfd9b60
I20260807 15:08:30.639129 28445 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178"
dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
mode: GRACEFUL
new_leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:49156
I20260807 15:08:30.639510 28445 raft_consensus.cc:595] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Received request to transfer leadership to TS 22175a41bb7b4ad6b4e0e55ce06c1115
I20260807 15:08:30.640368 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 15:08:30.640771 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:30.781574 28765 raft_consensus.cc:979] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:30.782076 28766 raft_consensus.cc:1067] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Signalling peer 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:30.783679 28369 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "64d0088290624819a603685d23665f50"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:51718
I20260807 15:08:30.784236 28369 raft_consensus.cc:482] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:30.784493 28369 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.788887 28369 raft_consensus.cc:504] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.790632 28369 leader_election.cc:288] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 4 election: Requested vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:30.791709 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:30.791972 28522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64d0088290624819a603685d23665f50" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:30.792269 28445 raft_consensus.cc:3032] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:08:30.792523 28522 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.792564 28445 raft_consensus.cc:729] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:30.793411 28445 consensus_queue.cc:260] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.794371 28445 raft_consensus.cc:3037] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.797382 28522 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 4.
I20260807 15:08:30.798588 28332 leader_election.cc:302] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:30.798954 28445 raft_consensus.cc:2454] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 4.
I20260807 15:08:30.800415 28767 raft_consensus.cc:2781] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:08:30.801622 28767 raft_consensus.cc:686] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 LEADER]: Becoming Leader. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:30.802688 28767 consensus_queue.cc:237] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.812506 28259 catalog_manager.cc:5495] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 reported cstate change: term changed from 3 to 4, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193). New cstate: current_term: 4 leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:30.825592 28765 raft_consensus.cc:979] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:30.825917 28766 raft_consensus.cc:979] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:30.826257 28774 raft_consensus.cc:1067] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Signalling peer 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:30.826498 28766 raft_consensus.cc:1067] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Signalling peer 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:30.828263 28369 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:51718
I20260807 15:08:30.828527 28522 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:35552
I20260807 15:08:30.828872 28369 raft_consensus.cc:482] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:30.829108 28522 raft_consensus.cc:482] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:30.829486 28522 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.829475 28369 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.834388 28522 raft_consensus.cc:504] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:30.834753 28369 raft_consensus.cc:504] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.836526 28522 leader_election.cc:288] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 4 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:30.837778 28369 leader_election.cc:288] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 4 election: Requested vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:30.838013 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:30.837930 28365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f491292245984b0d8d11a84fbbf5d178" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:30.839123 28365 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.839286 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:30.839849 28523 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.837937 28445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "381edde009404bf285fabf32d2eaf3d8" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:30.841229 28445 raft_consensus.cc:3032] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:08:30.841518 28445 raft_consensus.cc:729] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:30.838706 28446 raft_consensus.cc:3032] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:08:30.842299 28446 raft_consensus.cc:729] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:30.842298 28445 consensus_queue.cc:260] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.843539 28445 raft_consensus.cc:3037] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.843350 28446 consensus_queue.cc:260] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:30.844641 28446 raft_consensus.cc:3037] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:30.846261 28365 raft_consensus.cc:2454] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 4.
I20260807 15:08:30.846720 28523 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 4.
I20260807 15:08:30.847877 28485 leader_election.cc:302] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:30.848387 28332 leader_election.cc:302] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:30.848778 28728 raft_consensus.cc:2781] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:08:30.849226 28767 raft_consensus.cc:2781] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:08:30.849728 28767 raft_consensus.cc:686] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 LEADER]: Becoming Leader. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:30.850629 28445 raft_consensus.cc:2454] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 4.
I20260807 15:08:30.850697 28767 consensus_queue.cc:237] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.851639 28446 raft_consensus.cc:2454] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 4.
I20260807 15:08:30.852564 28728 raft_consensus.cc:686] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 LEADER]: Becoming Leader. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:30.853436 28728 consensus_queue.cc:237] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } }
I20260807 15:08:30.860595 28259 catalog_manager.cc:5495] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 reported cstate change: term changed from 3 to 4, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193). New cstate: current_term: 4 leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:30.861559 28260 catalog_manager.cc:5495] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 reported cstate change: term changed from 3 to 4, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:30.877802 28774 raft_consensus.cc:979] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:30.878276 28766 raft_consensus.cc:1067] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Signalling peer 5144217a8a5443aa8a00f8d60cfd9b60 to start an election
I20260807 15:08:30.879693 28365 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808"
dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
from {username='slave'} at 127.0.0.1:51718
I20260807 15:08:30.880272 28365 raft_consensus.cc:482] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:30.880602 28365 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:30.885756 28365 raft_consensus.cc:504] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.887509 28365 leader_election.cc:288] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 3 election: Requested vote from peers 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375), 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195:39771)
I20260807 15:08:30.888422 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:30.888656 28523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d4dfb94124461c83fbfb0e8b784808" candidate_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
I20260807 15:08:30.888965 28446 raft_consensus.cc:3032] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:30.889246 28523 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:30.889259 28446 raft_consensus.cc:729] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:30.890341 28446 consensus_queue.cc:260] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.891953 28446 raft_consensus.cc:3037] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:30.895375 28523 raft_consensus.cc:2454] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 3.
I20260807 15:08:30.896392 28332 leader_election.cc:302] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:30.897287 28767 raft_consensus.cc:2781] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:30.897531 28446 raft_consensus.cc:2454] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5144217a8a5443aa8a00f8d60cfd9b60 in term 3.
I20260807 15:08:30.897776 28767 raft_consensus.cc:686] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 LEADER]: Becoming Leader. State: Replica: 5144217a8a5443aa8a00f8d60cfd9b60, State: Running, Role: LEADER
I20260807 15:08:30.898720 28767 consensus_queue.cc:237] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.905916 28260 catalog_manager.cc:5495] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 reported cstate change: term changed from 2 to 3, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193). New cstate: current_term: 3 leader_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:30.925994 28774 raft_consensus.cc:979] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c: : Instructing follower 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:30.926544 28766 raft_consensus.cc:1067] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Signalling peer 22175a41bb7b4ad6b4e0e55ce06c1115 to start an election
I20260807 15:08:30.928308 28523 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a"
dest_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115"
from {username='slave'} at 127.0.0.1:35552
I20260807 15:08:30.928738 28523 raft_consensus.cc:482] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:30.928973 28523 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:30.935340 28523 raft_consensus.cc:504] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.937530 28523 leader_election.cc:288] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 3 election: Requested vote from peers 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507), 35da3a06e22848089a706c5ed81cc90c (127.27.144.194:41375)
I20260807 15:08:30.938791 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35da3a06e22848089a706c5ed81cc90c"
I20260807 15:08:30.938792 28365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c9c66d3405f47d28fe65bf86d2f271a" candidate_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5144217a8a5443aa8a00f8d60cfd9b60"
I20260807 15:08:30.939545 28446 raft_consensus.cc:3032] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:30.939549 28365 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:30.940052 28446 raft_consensus.cc:729] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35da3a06e22848089a706c5ed81cc90c, State: Running, Role: LEADER
I20260807 15:08:30.940826 28446 consensus_queue.cc:260] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.942047 28446 raft_consensus.cc:3037] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:30.947470 28365 raft_consensus.cc:2454] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 3.
I20260807 15:08:30.948459 28446 raft_consensus.cc:2454] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22175a41bb7b4ad6b4e0e55ce06c1115 in term 3.
I20260807 15:08:30.949048 28485 leader_election.cc:302] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22175a41bb7b4ad6b4e0e55ce06c1115, 5144217a8a5443aa8a00f8d60cfd9b60; no voters:
I20260807 15:08:30.950383 28728 raft_consensus.cc:2781] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:30.950804 28728 raft_consensus.cc:686] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 LEADER]: Becoming Leader. State: Replica: 22175a41bb7b4ad6b4e0e55ce06c1115, State: Running, Role: LEADER
I20260807 15:08:30.951558 28728 consensus_queue.cc:237] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } }
I20260807 15:08:30.961201 28260 catalog_manager.cc:5495] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 reported cstate change: term changed from 2 to 3, leader changed from 35da3a06e22848089a706c5ed81cc90c (127.27.144.194) to 22175a41bb7b4ad6b4e0e55ce06c1115 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 } health_report { overall_health: HEALTHY } } }
W20260807 15:08:31.136801 28295 debug-util.cc:398] Leaking SignalData structure 0x7b0800060060 after lost signal to thread 28230
W20260807 15:08:31.137899 28295 debug-util.cc:398] Leaking SignalData structure 0x7b0800060740 after lost signal to thread 28298
W20260807 15:08:31.138906 28295 debug-util.cc:398] Leaking SignalData structure 0x7b080009d9a0 after lost signal to thread 28394
W20260807 15:08:31.139727 28295 debug-util.cc:398] Leaking SignalData structure 0x7b080013e500 after lost signal to thread 28470
W20260807 15:08:31.140640 28295 debug-util.cc:398] Leaking SignalData structure 0x7b080013e460 after lost signal to thread 28547
I20260807 15:08:31.283846 28523 raft_consensus.cc:1261] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:31.285597 28767 consensus_queue.cc:1035] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:31.313100 28446 raft_consensus.cc:1261] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:31.315222 28768 consensus_queue.cc:1035] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:08:31.333877 28445 raft_consensus.cc:1261] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:31.335882 28728 consensus_queue.cc:1035] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:08:31.345507 28523 raft_consensus.cc:1261] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:31.351950 28445 raft_consensus.cc:1261] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:31.354197 28767 consensus_queue.cc:1035] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:08:31.361493 28785 consensus_queue.cc:1035] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:08:31.366080 28365 raft_consensus.cc:1261] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:31.369521 28365 raft_consensus.cc:1261] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:31.375387 28728 consensus_queue.cc:1035] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:31.390296 28522 raft_consensus.cc:1261] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:31.392493 28768 consensus_queue.cc:1035] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22175a41bb7b4ad6b4e0e55ce06c1115" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 39771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:08:31.409956 28445 raft_consensus.cc:1261] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Refusing update from remote peer 5144217a8a5443aa8a00f8d60cfd9b60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:31.417017 28792 consensus_queue.cc:1035] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
W20260807 15:08:31.426786 28485 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:38507, user_credentials={real_user=slave}} blocked reactor thread for 53130.5us
I20260807 15:08:31.429850 28790 consensus_queue.cc:1035] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5144217a8a5443aa8a00f8d60cfd9b60" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 38507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:08:31.433351 28446 raft_consensus.cc:1261] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Refusing update from remote peer 22175a41bb7b4ad6b4e0e55ce06c1115: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:31.438390 28790 consensus_queue.cc:1035] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35da3a06e22848089a706c5ed81cc90c" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:08:31.641646 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:31.646698 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:31.647176 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:32.648149 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:32.653043 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:32.653551 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:33.654451 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:33.660027 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:33.660519 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:34.661391 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:34.666535 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:34.666992 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:35.667766 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:35.672848 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:35.673223 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:36.674048 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:36.678885 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:36.679242 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:37.680171 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:37.685618 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:37.686019 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:38.687098 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:38.693187 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:38.693672 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:39.694576 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:39.700238 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:39.700719 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:40.728178 28227 auto_leader_rebalancer-test.cc:314] The leader distribution is
I20260807 15:08:40.728830 28227 tablet_server.cc:178] TabletServer@127.27.144.193:0 shutting down...
I20260807 15:08:40.762817 28227 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 15:08:40.763617 28227 tablet_replica.cc:330] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.764586 28227 raft_consensus.cc:2229] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 LEADER]: Raft consensus shutting down.
I20260807 15:08:40.766029 28227 raft_consensus.cc:2258] T 381edde009404bf285fabf32d2eaf3d8 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.769336 28227 tablet_replica.cc:330] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.769908 28227 raft_consensus.cc:2229] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.770362 28227 raft_consensus.cc:2258] T 3592f94a979c481a8982c6aba50daf12 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.772260 28227 tablet_replica.cc:330] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.772828 28227 raft_consensus.cc:2229] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.773257 28227 raft_consensus.cc:2258] T 0c9c66d3405f47d28fe65bf86d2f271a P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.774994 28227 tablet_replica.cc:330] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.775535 28227 raft_consensus.cc:2229] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.776114 28227 raft_consensus.cc:2258] T f491292245984b0d8d11a84fbbf5d178 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.777947 28227 tablet_replica.cc:330] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.778435 28227 raft_consensus.cc:2229] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.778849 28227 raft_consensus.cc:2258] T 26236b6e40994f0f82e109182f76e32b P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.780525 28227 tablet_replica.cc:330] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.781014 28227 raft_consensus.cc:2229] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.781528 28227 raft_consensus.cc:2258] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.783349 28227 tablet_replica.cc:330] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.783825 28227 raft_consensus.cc:2229] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.784313 28227 raft_consensus.cc:2258] T d025293a4e9740599a19750cb0ae98d3 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.786041 28227 tablet_replica.cc:330] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.786532 28227 raft_consensus.cc:2229] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 LEADER]: Raft consensus shutting down.
I20260807 15:08:40.787463 28227 raft_consensus.cc:2258] T 64d0088290624819a603685d23665f50 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.789747 28227 tablet_replica.cc:330] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60: stopping tablet replica
I20260807 15:08:40.790381 28227 raft_consensus.cc:2229] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 LEADER]: Raft consensus shutting down.
I20260807 15:08:40.791297 28227 raft_consensus.cc:2258] T a8d4dfb94124461c83fbfb0e8b784808 P 5144217a8a5443aa8a00f8d60cfd9b60 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260807 15:08:40.893554 28485 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.144.193:38507: connect: Connection refused (error 111)
W20260807 15:08:40.897948 28485 consensus_peers.cc:487] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 -> Peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Couldn't send request to peer 5144217a8a5443aa8a00f8d60cfd9b60. Status: Network error: Client connection negotiation failed: client connection to 127.27.144.193:38507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 15:08:40.907347 28227 tablet_server.cc:194] TabletServer@127.27.144.193:0 shutdown complete.
I20260807 15:08:40.928573 28227 tablet_server.cc:178] TabletServer@127.27.144.194:0 shutting down...
W20260807 15:08:40.948009 28410 consensus_peers.cc:487] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c -> Peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Couldn't send request to peer 5144217a8a5443aa8a00f8d60cfd9b60. Status: Network error: Client connection negotiation failed: client connection to 127.27.144.193:38507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 15:08:40.972259 28227 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 15:08:40.973022 28227 tablet_replica.cc:330] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.973766 28227 raft_consensus.cc:2229] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 3 LEADER]: Raft consensus shutting down.
I20260807 15:08:40.974650 28227 raft_consensus.cc:2258] T 26236b6e40994f0f82e109182f76e32b P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.976476 28227 tablet_replica.cc:330] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.976998 28227 raft_consensus.cc:2229] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.977432 28227 raft_consensus.cc:2258] T 381edde009404bf285fabf32d2eaf3d8 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.979177 28227 tablet_replica.cc:330] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.979660 28227 raft_consensus.cc:2229] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.980170 28227 raft_consensus.cc:2258] T 64d0088290624819a603685d23665f50 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.981746 28227 tablet_replica.cc:330] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.982235 28227 raft_consensus.cc:2229] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.982662 28227 raft_consensus.cc:2258] T f491292245984b0d8d11a84fbbf5d178 P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.984373 28227 tablet_replica.cc:330] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.984866 28227 raft_consensus.cc:2229] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.985285 28227 raft_consensus.cc:2258] T 0c9c66d3405f47d28fe65bf86d2f271a P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.986924 28227 tablet_replica.cc:330] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.987387 28227 raft_consensus.cc:2229] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:08:40.988236 28227 raft_consensus.cc:2258] T 3592f94a979c481a8982c6aba50daf12 P 35da3a06e22848089a706c5ed81cc90c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.989909 28227 tablet_replica.cc:330] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.990375 28227 raft_consensus.cc:2229] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 4 LEADER]: Raft consensus shutting down.
I20260807 15:08:40.991189 28227 raft_consensus.cc:2258] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 35da3a06e22848089a706c5ed81cc90c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.992759 28227 tablet_replica.cc:330] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.993286 28227 raft_consensus.cc:2229] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.993695 28227 raft_consensus.cc:2258] T d025293a4e9740599a19750cb0ae98d3 P 35da3a06e22848089a706c5ed81cc90c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:40.995437 28227 tablet_replica.cc:330] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c: stopping tablet replica
I20260807 15:08:40.995875 28227 raft_consensus.cc:2229] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:40.996307 28227 raft_consensus.cc:2258] T a8d4dfb94124461c83fbfb0e8b784808 P 35da3a06e22848089a706c5ed81cc90c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260807 15:08:41.017495 28485 consensus_peers.cc:487] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 -> Peer 5144217a8a5443aa8a00f8d60cfd9b60 (127.27.144.193:38507): Couldn't send request to peer 5144217a8a5443aa8a00f8d60cfd9b60. Status: Network error: Client connection negotiation failed: client connection to 127.27.144.193:38507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 15:08:41.026518 28227 tablet_server.cc:194] TabletServer@127.27.144.194:0 shutdown complete.
I20260807 15:08:41.045006 28227 tablet_server.cc:178] TabletServer@127.27.144.195:0 shutting down...
I20260807 15:08:41.078869 28227 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 15:08:41.079536 28227 tablet_replica.cc:330] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.080207 28227 raft_consensus.cc:2229] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:41.080678 28227 raft_consensus.cc:2258] T 381edde009404bf285fabf32d2eaf3d8 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.082482 28227 tablet_replica.cc:330] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.083029 28227 raft_consensus.cc:2229] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:41.083489 28227 raft_consensus.cc:2258] T 64d0088290624819a603685d23665f50 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.085227 28227 tablet_replica.cc:330] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.085721 28227 raft_consensus.cc:2229] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 LEADER]: Raft consensus shutting down.
I20260807 15:08:41.086511 28227 raft_consensus.cc:2258] T f491292245984b0d8d11a84fbbf5d178 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.088231 28227 tablet_replica.cc:330] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.088703 28227 raft_consensus.cc:2229] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:41.089113 28227 raft_consensus.cc:2258] T 3592f94a979c481a8982c6aba50daf12 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.090724 28227 tablet_replica.cc:330] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.091202 28227 raft_consensus.cc:2229] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 LEADER]: Raft consensus shutting down.
I20260807 15:08:41.092048 28227 raft_consensus.cc:2258] T 0c9c66d3405f47d28fe65bf86d2f271a P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.093652 28227 tablet_replica.cc:330] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.094130 28227 raft_consensus.cc:2229] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:41.094527 28227 raft_consensus.cc:2258] T 26236b6e40994f0f82e109182f76e32b P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.096148 28227 tablet_replica.cc:330] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.096601 28227 raft_consensus.cc:2229] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:41.097008 28227 raft_consensus.cc:2258] T a8d4dfb94124461c83fbfb0e8b784808 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.098801 28227 tablet_replica.cc:330] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.099255 28227 raft_consensus.cc:2229] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 LEADER]: Raft consensus shutting down.
I20260807 15:08:41.100088 28227 raft_consensus.cc:2258] T d025293a4e9740599a19750cb0ae98d3 P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.101728 28227 tablet_replica.cc:330] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115: stopping tablet replica
I20260807 15:08:41.102202 28227 raft_consensus.cc:2229] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:08:41.102679 28227 raft_consensus.cc:2258] T 4d297f80ed4d4d889e91a1a04ca4fb6e P 22175a41bb7b4ad6b4e0e55ce06c1115 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.133000 28227 tablet_server.cc:194] TabletServer@127.27.144.195:0 shutdown complete.
I20260807 15:08:41.152040 28227 master.cc:537] Master@127.27.144.254:45551 shutting down...
I20260807 15:08:41.310796 28227 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:08:41.311399 28227 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:08:41.311760 28227 tablet_replica.cc:330] T 00000000000000000000000000000000 P 51576316e08f417f8b89aa176a3b48f1: stopping tablet replica
I20260807 15:08:41.346974 28227 master.cc:552] Master@127.27.144.254:45551 shutdown complete.
22175a41bb7b4ad6b4e0e55ce06c1115 1
35da3a06e22848089a706c5ed81cc90c 4
5144217a8a5443aa8a00f8d60cfd9b60 4
22175a41bb7b4ad6b4e0e55ce06c1115 3
35da3a06e22848089a706c5ed81cc90c 3
5144217a8a5443aa8a00f8d60cfd9b60 3
22175a41bb7b4ad6b4e0e55ce06c1115 1
35da3a06e22848089a706c5ed81cc90c 8
5144217a8a5443aa8a00f8d60cfd9b60 0
22175a41bb7b4ad6b4e0e55ce06c1115 3
35da3a06e22848089a706c5ed81cc90c 3
5144217a8a5443aa8a00f8d60cfd9b60 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (33481 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260807 15:08:41.394081 28227 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.144.254:42227
I20260807 15:08:41.395249 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:08:41.401216 28815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:41.401332 28814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:41.402468 28818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:41.403716 28227 server_base.cc:1034] running on GCE node
I20260807 15:08:41.405364 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:08:41.405556 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:08:41.405669 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115321405660 us; error 0 us; skew 500 ppm
I20260807 15:08:41.406113 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:08:41.408787 28227 webserver.cc:460] Webserver started at http://127.27.144.254:42005/ using document root <none> and password file <none>
I20260807 15:08:41.409267 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:08:41.409423 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:08:41.409651 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:08:41.410828 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/master-0-root/instance:
uuid: "0118bbb4f500429987a8bc2219a77974"
format_stamp: "Formatted at 2026-08-07 15:08:41 on dist-test-slave-27sr"
I20260807 15:08:41.415637 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:08:41.419097 28823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.419976 28227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:08:41.420289 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/master-0-root
uuid: "0118bbb4f500429987a8bc2219a77974"
format_stamp: "Formatted at 2026-08-07 15:08:41 on dist-test-slave-27sr"
I20260807 15:08:41.420598 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:08:41.459448 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:08:41.460927 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:08:41.501652 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.254:42227
I20260807 15:08:41.501747 28879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.254:42227 every 8 connection(s)
I20260807 15:08:41.505889 28880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:41.515566 28880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974: Bootstrap starting.
I20260807 15:08:41.520280 28880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:41.525012 28880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974: No bootstrap required, opened a new log
I20260807 15:08:41.527194 28880 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0118bbb4f500429987a8bc2219a77974" member_type: VOTER }
I20260807 15:08:41.527729 28880 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:41.527990 28880 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0118bbb4f500429987a8bc2219a77974, State: Initialized, Role: FOLLOWER
I20260807 15:08:41.528523 28880 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0118bbb4f500429987a8bc2219a77974" member_type: VOTER }
I20260807 15:08:41.528987 28880 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:08:41.529219 28880 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:08:41.529489 28880 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:41.533591 28880 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0118bbb4f500429987a8bc2219a77974" member_type: VOTER }
I20260807 15:08:41.534137 28880 leader_election.cc:302] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0118bbb4f500429987a8bc2219a77974; no voters:
I20260807 15:08:41.535393 28880 leader_election.cc:288] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:08:41.535830 28883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:41.537415 28883 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 1 LEADER]: Becoming Leader. State: Replica: 0118bbb4f500429987a8bc2219a77974, State: Running, Role: LEADER
I20260807 15:08:41.538141 28883 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0118bbb4f500429987a8bc2219a77974" member_type: VOTER }
I20260807 15:08:41.538723 28880 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:08:41.543617 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0118bbb4f500429987a8bc2219a77974" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0118bbb4f500429987a8bc2219a77974" member_type: VOTER } }
I20260807 15:08:41.544166 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [sys.catalog]: This master's current role is: LEADER
I20260807 15:08:41.543464 28885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0118bbb4f500429987a8bc2219a77974. Latest consensus state: current_term: 1 leader_uuid: "0118bbb4f500429987a8bc2219a77974" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0118bbb4f500429987a8bc2219a77974" member_type: VOTER } }
I20260807 15:08:41.545109 28885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [sys.catalog]: This master's current role is: LEADER
I20260807 15:08:41.547178 28891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:08:41.556077 28891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:08:41.557164 28227 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 15:08:41.565626 28891 catalog_manager.cc:1347] Generated new cluster ID: a873b079040843249ef6d398d0da43d1
I20260807 15:08:41.565944 28891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:08:41.584300 28891 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:08:41.586053 28891 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:08:41.605098 28891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974: Generated new TSK 0
I20260807 15:08:41.605836 28891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:08:41.624135 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:08:41.630884 28902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:41.632479 28903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:41.634066 28905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:41.634262 28227 server_base.cc:1034] running on GCE node
I20260807 15:08:41.635527 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:08:41.635733 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:08:41.635989 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115321635971 us; error 0 us; skew 500 ppm
I20260807 15:08:41.636510 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:08:41.638847 28227 webserver.cc:460] Webserver started at http://127.27.144.193:45157/ using document root <none> and password file <none>
I20260807 15:08:41.639516 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:08:41.639712 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:08:41.640089 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:08:41.641350 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-0-root/instance:
uuid: "a26048c84be94fb488a146f9d1205b63"
format_stamp: "Formatted at 2026-08-07 15:08:41 on dist-test-slave-27sr"
I20260807 15:08:41.646119 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:08:41.650142 28910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.651073 28227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:08:41.651347 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-0-root
uuid: "a26048c84be94fb488a146f9d1205b63"
format_stamp: "Formatted at 2026-08-07 15:08:41 on dist-test-slave-27sr"
I20260807 15:08:41.651700 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:08:41.686417 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:08:41.687700 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:08:41.689270 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:08:41.691572 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:08:41.691749 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.692082 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:08:41.692261 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.734143 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.193:35091
I20260807 15:08:41.734234 28975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.193:35091 every 8 connection(s)
I20260807 15:08:41.738955 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:08:41.747174 28980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:41.747702 28981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:41.750702 28983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:41.751569 28227 server_base.cc:1034] running on GCE node
I20260807 15:08:41.752979 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:08:41.753204 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:08:41.753387 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115321753372 us; error 0 us; skew 500 ppm
I20260807 15:08:41.754032 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:08:41.756201 28976 heartbeater.cc:347] Connected to a master server at 127.27.144.254:42227
I20260807 15:08:41.756649 28976 heartbeater.cc:464] Registering TS with master...
I20260807 15:08:41.757028 28227 webserver.cc:460] Webserver started at http://127.27.144.194:34621/ using document root <none> and password file <none>
I20260807 15:08:41.757577 28976 heartbeater.cc:511] Master 127.27.144.254:42227 requested a full tablet report, sending...
I20260807 15:08:41.757702 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:08:41.757963 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:08:41.758313 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:08:41.759802 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-1-root/instance:
uuid: "2e170a81ade34927b5e90c5fb90700e4"
format_stamp: "Formatted at 2026-08-07 15:08:41 on dist-test-slave-27sr"
I20260807 15:08:41.760002 28841 ts_manager.cc:194] Registered new tserver with Master: a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091)
I20260807 15:08:41.762002 28841 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47534
I20260807 15:08:41.765168 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 15:08:41.768788 28988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.769830 28227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:08:41.770190 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-1-root
uuid: "2e170a81ade34927b5e90c5fb90700e4"
format_stamp: "Formatted at 2026-08-07 15:08:41 on dist-test-slave-27sr"
I20260807 15:08:41.770571 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:08:41.784792 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:08:41.786062 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:08:41.787664 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:08:41.790145 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:08:41.790380 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.790642 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:08:41.790807 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.835487 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.194:46117
I20260807 15:08:41.835584 29053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.194:46117 every 8 connection(s)
I20260807 15:08:41.841077 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:08:41.850286 29057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:41.851833 29058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:08:41.855773 29060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:08:41.857527 29054 heartbeater.cc:347] Connected to a master server at 127.27.144.254:42227
I20260807 15:08:41.857982 29054 heartbeater.cc:464] Registering TS with master...
I20260807 15:08:41.858753 29054 heartbeater.cc:511] Master 127.27.144.254:42227 requested a full tablet report, sending...
I20260807 15:08:41.860875 28841 ts_manager.cc:194] Registered new tserver with Master: 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:41.861624 28227 server_base.cc:1034] running on GCE node
I20260807 15:08:41.862638 28841 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47542
I20260807 15:08:41.862738 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:08:41.863076 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:08:41.863322 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115321863305 us; error 0 us; skew 500 ppm
I20260807 15:08:41.864215 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:08:41.867123 28227 webserver.cc:460] Webserver started at http://127.27.144.195:33347/ using document root <none> and password file <none>
I20260807 15:08:41.867620 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:08:41.867808 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:08:41.868130 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:08:41.869602 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-2-root/instance:
uuid: "b8eec748acf34c16a0ef093057a3870a"
format_stamp: "Formatted at 2026-08-07 15:08:41 on dist-test-slave-27sr"
I20260807 15:08:41.874644 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:08:41.878536 29065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.879318 28227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:08:41.879575 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-2-root
uuid: "b8eec748acf34c16a0ef093057a3870a"
format_stamp: "Formatted at 2026-08-07 15:08:41 on dist-test-slave-27sr"
I20260807 15:08:41.879807 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786115287678881-28227-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:08:41.895576 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:08:41.896814 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:08:41.898200 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:08:41.900614 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:08:41.900789 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.901086 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:08:41.901239 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:08:41.942685 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.195:46027
I20260807 15:08:41.942795 29131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.195:46027 every 8 connection(s)
I20260807 15:08:41.959100 29132 heartbeater.cc:347] Connected to a master server at 127.27.144.254:42227
I20260807 15:08:41.959543 29132 heartbeater.cc:464] Registering TS with master...
I20260807 15:08:41.960268 29132 heartbeater.cc:511] Master 127.27.144.254:42227 requested a full tablet report, sending...
I20260807 15:08:41.962255 28841 ts_manager.cc:194] Registered new tserver with Master: b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:41.963161 28227 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017345261s
I20260807 15:08:41.964304 28841 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47548
I20260807 15:08:41.966289 28227 test_util.cc:268] Using random seed: 1632317114
I20260807 15:08:41.990137 28841 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47558:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:08:41.993036 28841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:08:42.061291 29094 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc7f0474b1a4b7e9cd9914f563ab25e (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 15:08:42.062790 29094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc7f0474b1a4b7e9cd9914f563ab25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.066052 29090 tablet_service.cc:1467] Processing CreateTablet for tablet 5bcd7122cb164973aa89412d58bdba12 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 15:08:42.066283 29091 tablet_service.cc:1467] Processing CreateTablet for tablet bd9a7e182d834b58926232f982697295 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 15:08:42.067698 29090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bcd7122cb164973aa89412d58bdba12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.067345 29092 tablet_service.cc:1467] Processing CreateTablet for tablet 3a3126cc355c49c4b89a108444f200d1 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 15:08:42.068374 29091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9a7e182d834b58926232f982697295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.066052 29093 tablet_service.cc:1467] Processing CreateTablet for tablet ebf88fa06c3f4acabe37f641d007ff54 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 15:08:42.070468 29092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a3126cc355c49c4b89a108444f200d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.071781 29093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebf88fa06c3f4acabe37f641d007ff54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.078704 29089 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2bf7fa7f4b473b816ae503fe9f64a7 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 15:08:42.080145 29089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2bf7fa7f4b473b816ae503fe9f64a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.092275 28940 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc7f0474b1a4b7e9cd9914f563ab25e (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 15:08:42.093726 28940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc7f0474b1a4b7e9cd9914f563ab25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.095593 29088 tablet_service.cc:1467] Processing CreateTablet for tablet 3238b5df16f34781bf3b4e58010d1017 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 15:08:42.096951 29088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3238b5df16f34781bf3b4e58010d1017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.100782 28939 tablet_service.cc:1467] Processing CreateTablet for tablet ebf88fa06c3f4acabe37f641d007ff54 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 15:08:42.102219 28939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebf88fa06c3f4acabe37f641d007ff54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.102157 29087 tablet_service.cc:1467] Processing CreateTablet for tablet a55e7cb8d220466985728925e97bab75 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 15:08:42.104029 28934 tablet_service.cc:1467] Processing CreateTablet for tablet 3238b5df16f34781bf3b4e58010d1017 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 15:08:42.104672 28933 tablet_service.cc:1467] Processing CreateTablet for tablet a55e7cb8d220466985728925e97bab75 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 15:08:42.110692 29087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a55e7cb8d220466985728925e97bab75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.111317 28936 tablet_service.cc:1467] Processing CreateTablet for tablet 5bcd7122cb164973aa89412d58bdba12 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 15:08:42.114276 28935 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2bf7fa7f4b473b816ae503fe9f64a7 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 15:08:42.106030 28938 tablet_service.cc:1467] Processing CreateTablet for tablet 3a3126cc355c49c4b89a108444f200d1 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 15:08:42.108381 28937 tablet_service.cc:1467] Processing CreateTablet for tablet bd9a7e182d834b58926232f982697295 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 15:08:42.119820 29093 tablet_service.cc:1467] Processing CreateTablet for tablet d542463930bb44b095447ed9e2f2b745 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 15:08:42.121038 28934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3238b5df16f34781bf3b4e58010d1017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.121306 29093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d542463930bb44b095447ed9e2f2b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.124270 28933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a55e7cb8d220466985728925e97bab75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.128310 28938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a3126cc355c49c4b89a108444f200d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.131772 28936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bcd7122cb164973aa89412d58bdba12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.131922 28932 tablet_service.cc:1467] Processing CreateTablet for tablet d542463930bb44b095447ed9e2f2b745 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 15:08:42.133355 28932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d542463930bb44b095447ed9e2f2b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.136307 28937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9a7e182d834b58926232f982697295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.136476 28931 tablet_service.cc:1467] Processing CreateTablet for tablet bd3401a06dd34713843f26f578012f0e (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 15:08:42.137828 28931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3401a06dd34713843f26f578012f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.139635 28935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2bf7fa7f4b473b816ae503fe9f64a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.141501 29086 tablet_service.cc:1467] Processing CreateTablet for tablet bd3401a06dd34713843f26f578012f0e (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 15:08:42.142917 29086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3401a06dd34713843f26f578012f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.145166 29015 tablet_service.cc:1467] Processing CreateTablet for tablet ebf88fa06c3f4acabe37f641d007ff54 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 15:08:42.145586 29014 tablet_service.cc:1467] Processing CreateTablet for tablet 3a3126cc355c49c4b89a108444f200d1 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 15:08:42.146634 29015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebf88fa06c3f4acabe37f641d007ff54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.147835 29011 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2bf7fa7f4b473b816ae503fe9f64a7 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 15:08:42.149312 29011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2bf7fa7f4b473b816ae503fe9f64a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.149168 29013 tablet_service.cc:1467] Processing CreateTablet for tablet bd9a7e182d834b58926232f982697295 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 15:08:42.150569 29013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd9a7e182d834b58926232f982697295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.153155 29010 tablet_service.cc:1467] Processing CreateTablet for tablet 3238b5df16f34781bf3b4e58010d1017 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 15:08:42.156447 29008 tablet_service.cc:1467] Processing CreateTablet for tablet d542463930bb44b095447ed9e2f2b745 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 15:08:42.158835 29009 tablet_service.cc:1467] Processing CreateTablet for tablet a55e7cb8d220466985728925e97bab75 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 15:08:42.153163 29012 tablet_service.cc:1467] Processing CreateTablet for tablet 5bcd7122cb164973aa89412d58bdba12 (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 15:08:42.162796 29016 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc7f0474b1a4b7e9cd9914f563ab25e (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 15:08:42.162897 29007 tablet_service.cc:1467] Processing CreateTablet for tablet bd3401a06dd34713843f26f578012f0e (DEFAULT_TABLE table=test-workload [id=65a06e45fdf24975909fedf84dc9a249]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 15:08:42.163980 29014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a3126cc355c49c4b89a108444f200d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.165709 29010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3238b5df16f34781bf3b4e58010d1017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.166368 29016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc7f0474b1a4b7e9cd9914f563ab25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.167258 29007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd3401a06dd34713843f26f578012f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.168872 29012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bcd7122cb164973aa89412d58bdba12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.171638 29008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d542463930bb44b095447ed9e2f2b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.176280 29009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a55e7cb8d220466985728925e97bab75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:08:42.253544 29150 tablet_bootstrap.cc:492] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.253965 29149 tablet_bootstrap.cc:492] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.262705 29149 tablet_bootstrap.cc:654] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.262853 29147 tablet_bootstrap.cc:492] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.277838 29147 tablet_bootstrap.cc:654] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.278725 29150 tablet_bootstrap.cc:654] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.292140 29149 tablet_bootstrap.cc:492] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.292980 29149 ts_tablet_manager.cc:1397] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.039s user 0.017s sys 0.012s
I20260807 15:08:42.294210 29147 tablet_bootstrap.cc:492] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.294564 29147 ts_tablet_manager.cc:1397] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.009s
I20260807 15:08:42.295662 29149 raft_consensus.cc:348] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.296527 29149 raft_consensus.cc:374] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.296816 29149 raft_consensus.cc:729] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.297206 29147 raft_consensus.cc:348] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.297554 29149 consensus_queue.cc:260] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.298308 29147 raft_consensus.cc:374] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.298756 29147 raft_consensus.cc:729] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.299691 29147 consensus_queue.cc:260] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.306067 29132 heartbeater.cc:503] Master 127.27.144.254:42227 was elected leader, sending a full tablet report...
I20260807 15:08:42.306599 29147 ts_tablet_manager.cc:1428] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.012s user 0.000s sys 0.012s
I20260807 15:08:42.307102 28976 heartbeater.cc:503] Master 127.27.144.254:42227 was elected leader, sending a full tablet report...
I20260807 15:08:42.307495 29149 ts_tablet_manager.cc:1428] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.014s user 0.006s sys 0.008s
I20260807 15:08:42.307530 29147 tablet_bootstrap.cc:492] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.308565 29149 tablet_bootstrap.cc:492] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.314193 29147 tablet_bootstrap.cc:654] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.314626 29149 tablet_bootstrap.cc:654] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.317862 29150 tablet_bootstrap.cc:492] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.318687 29150 ts_tablet_manager.cc:1397] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.018s
I20260807 15:08:42.323043 29150 raft_consensus.cc:348] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.324693 29150 raft_consensus.cc:374] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.325165 29150 raft_consensus.cc:729] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.326436 29150 consensus_queue.cc:260] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.360584 29147 tablet_bootstrap.cc:492] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.360574 29149 tablet_bootstrap.cc:492] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.361274 29147 ts_tablet_manager.cc:1397] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.054s user 0.044s sys 0.007s
I20260807 15:08:42.361420 29149 ts_tablet_manager.cc:1397] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.053s user 0.025s sys 0.026s
I20260807 15:08:42.364202 29147 raft_consensus.cc:348] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.365097 29147 raft_consensus.cc:374] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.365455 29147 raft_consensus.cc:729] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.364950 29149 raft_consensus.cc:348] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.365959 29149 raft_consensus.cc:374] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.366358 29149 raft_consensus.cc:729] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.366317 29147 consensus_queue.cc:260] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.367487 29149 consensus_queue.cc:260] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.368789 29147 ts_tablet_manager.cc:1428] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:08:42.369464 29147 tablet_bootstrap.cc:492] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.369750 29149 ts_tablet_manager.cc:1428] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 15:08:42.369875 29054 heartbeater.cc:503] Master 127.27.144.254:42227 was elected leader, sending a full tablet report...
I20260807 15:08:42.370702 29149 tablet_bootstrap.cc:492] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.376571 29147 tablet_bootstrap.cc:654] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.376784 29149 tablet_bootstrap.cc:654] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.386780 29149 tablet_bootstrap.cc:492] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.387285 29149 ts_tablet_manager.cc:1397] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.003s
I20260807 15:08:42.387506 29150 ts_tablet_manager.cc:1428] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.068s user 0.019s sys 0.026s
I20260807 15:08:42.387634 29147 tablet_bootstrap.cc:492] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.388109 29147 ts_tablet_manager.cc:1397] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.019s user 0.015s sys 0.002s
I20260807 15:08:42.388576 29150 tablet_bootstrap.cc:492] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.389617 29149 raft_consensus.cc:348] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.390205 29149 raft_consensus.cc:374] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.390513 29149 raft_consensus.cc:729] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.390771 29147 raft_consensus.cc:348] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.391569 29147 raft_consensus.cc:374] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.391345 29149 consensus_queue.cc:260] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.391987 29147 raft_consensus.cc:729] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.392864 29147 consensus_queue.cc:260] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.393703 29149 ts_tablet_manager.cc:1428] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:08:42.394618 29149 tablet_bootstrap.cc:492] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.395064 29150 tablet_bootstrap.cc:654] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.395373 29147 ts_tablet_manager.cc:1428] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:08:42.396385 29147 tablet_bootstrap.cc:492] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.400619 29149 tablet_bootstrap.cc:654] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.403611 29147 tablet_bootstrap.cc:654] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.408795 29154 raft_consensus.cc:482] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.409405 29154 raft_consensus.cc:504] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.411583 29149 tablet_bootstrap.cc:492] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.412114 29149 ts_tablet_manager.cc:1397] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.000s
I20260807 15:08:42.415118 29149 raft_consensus.cc:348] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.415966 29149 raft_consensus.cc:374] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.416289 29149 raft_consensus.cc:729] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.416669 29154 leader_election.cc:288] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.417176 29149 consensus_queue.cc:260] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.419605 29154 raft_consensus.cc:482] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.420265 29154 raft_consensus.cc:504] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.419786 29147 tablet_bootstrap.cc:492] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.427343 29147 ts_tablet_manager.cc:1397] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.006s
I20260807 15:08:42.432833 29154 leader_election.cc:288] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:42.431027 29147 raft_consensus.cc:348] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.436527 29150 tablet_bootstrap.cc:492] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.436870 29147 raft_consensus.cc:374] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.437103 29150 ts_tablet_manager.cc:1397] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.049s user 0.015s sys 0.003s
I20260807 15:08:42.437284 29149 ts_tablet_manager.cc:1428] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.025s user 0.007s sys 0.016s
I20260807 15:08:42.437318 29147 raft_consensus.cc:729] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.438372 29147 consensus_queue.cc:260] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.440189 29150 raft_consensus.cc:348] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.440963 29150 raft_consensus.cc:374] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.441061 29147 ts_tablet_manager.cc:1428] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.013s user 0.009s sys 0.000s
I20260807 15:08:42.441272 29150 raft_consensus.cc:729] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.442351 29147 tablet_bootstrap.cc:492] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.442178 29150 consensus_queue.cc:260] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.445202 29149 tablet_bootstrap.cc:492] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
W20260807 15:08:42.446815 29133 tablet.cc:2369] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:08:42.449402 29147 tablet_bootstrap.cc:654] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.451221 29150 ts_tablet_manager.cc:1428] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260807 15:08:42.454531 29149 tablet_bootstrap.cc:654] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.455009 29150 tablet_bootstrap.cc:492] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.463065 29150 tablet_bootstrap.cc:654] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.463765 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bcd7122cb164973aa89412d58bdba12" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:42.464903 29106 raft_consensus.cc:2454] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 0.
I20260807 15:08:42.466612 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:42.468385 28914 leader_election.cc:302] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
W20260807 15:08:42.469411 28914 leader_election.cc:341] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.470237 29166 raft_consensus.cc:2781] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.470662 29166 raft_consensus.cc:482] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.471019 29166 raft_consensus.cc:3037] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.470464 29147 tablet_bootstrap.cc:492] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.471837 29147 ts_tablet_manager.cc:1397] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.030s user 0.015s sys 0.012s
I20260807 15:08:42.474026 29149 tablet_bootstrap.cc:492] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.474536 29149 ts_tablet_manager.cc:1397] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.030s user 0.013s sys 0.010s
I20260807 15:08:42.475593 29147 raft_consensus.cc:348] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.476451 29147 raft_consensus.cc:374] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.476761 29147 raft_consensus.cc:729] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.476894 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bcd7122cb164973aa89412d58bdba12" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:42.477622 29026 raft_consensus.cc:2454] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 0.
I20260807 15:08:42.477420 29149 raft_consensus.cc:348] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.477523 29147 consensus_queue.cc:260] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.478255 29149 raft_consensus.cc:374] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.478555 29149 raft_consensus.cc:729] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.478976 29025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:42.479365 29149 consensus_queue.cc:260] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.479995 29147 ts_tablet_manager.cc:1428] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 15:08:42.482048 29149 ts_tablet_manager.cc:1428] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 15:08:42.481999 29166 raft_consensus.cc:504] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.483124 29150 tablet_bootstrap.cc:492] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.483215 29149 tablet_bootstrap.cc:492] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.483664 29150 ts_tablet_manager.cc:1397] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.001s
I20260807 15:08:42.484608 29166 leader_election.cc:288] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.485731 29147 tablet_bootstrap.cc:492] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.486469 29150 raft_consensus.cc:348] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.487308 29150 raft_consensus.cc:374] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.487615 29150 raft_consensus.cc:729] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.488073 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bcd7122cb164973aa89412d58bdba12" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:42.488703 29103 raft_consensus.cc:3037] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.488473 29150 consensus_queue.cc:260] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.489678 29149 tablet_bootstrap.cc:654] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.492230 29147 tablet_bootstrap.cc:654] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
W20260807 15:08:42.493484 28912 leader_election.cc:341] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.493847 29150 ts_tablet_manager.cc:1428] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 15:08:42.493916 28912 leader_election.cc:302] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a26048c84be94fb488a146f9d1205b63; no voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:42.495252 29166 raft_consensus.cc:2726] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:42.495234 29150 tablet_bootstrap.cc:492] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.497632 29025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bcd7122cb164973aa89412d58bdba12" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:42.498528 29025 raft_consensus.cc:3037] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.500473 29166 raft_consensus.cc:482] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.501171 29166 raft_consensus.cc:504] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.505318 29166 leader_election.cc:288] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.505522 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:42.508046 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:42.508924 29106 raft_consensus.cc:2454] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 0.
I20260807 15:08:42.510671 28914 leader_election.cc:302] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:42.512403 29166 raft_consensus.cc:2781] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 15:08:42.512353 28912 leader_election.cc:341] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.513070 29166 raft_consensus.cc:482] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.513518 29166 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.511673 29150 tablet_bootstrap.cc:654] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.516815 29149 tablet_bootstrap.cc:492] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.517406 29149 ts_tablet_manager.cc:1397] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.034s user 0.017s sys 0.016s
I20260807 15:08:42.521090 29149 raft_consensus.cc:348] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.521929 29149 raft_consensus.cc:374] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.522269 29149 raft_consensus.cc:729] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.523031 29149 consensus_queue.cc:260] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.523801 29166 raft_consensus.cc:504] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.525772 29149 ts_tablet_manager.cc:1428] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 15:08:42.526264 29147 tablet_bootstrap.cc:492] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.526782 29147 ts_tablet_manager.cc:1397] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.041s user 0.013s sys 0.015s
I20260807 15:08:42.526830 29149 tablet_bootstrap.cc:492] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.526918 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
W20260807 15:08:42.528172 28912 leader_election.cc:341] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.530319 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:42.530045 29147 raft_consensus.cc:348] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.530898 29106 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.531023 29147 raft_consensus.cc:374] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.531423 29147 raft_consensus.cc:729] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.532362 29147 consensus_queue.cc:260] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.534019 29149 tablet_bootstrap.cc:654] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.535387 29147 ts_tablet_manager.cc:1428] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260807 15:08:42.537170 29166 leader_election.cc:288] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.536509 29147 tablet_bootstrap.cc:492] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.541776 29158 raft_consensus.cc:482] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.542297 29158 raft_consensus.cc:504] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.543673 29103 raft_consensus.cc:2454] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 1.
I20260807 15:08:42.545769 28914 leader_election.cc:302] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:42.546867 29166 raft_consensus.cc:2781] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.547423 29166 raft_consensus.cc:686] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:42.548559 29166 consensus_queue.cc:237] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.547767 29025 raft_consensus.cc:2454] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 1.
I20260807 15:08:42.558314 29149 tablet_bootstrap.cc:492] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.558995 29149 ts_tablet_manager.cc:1397] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.032s user 0.014s sys 0.013s
W20260807 15:08:42.560527 28893 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:08:42.551779 29106 raft_consensus.cc:2454] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 1.
I20260807 15:08:42.562637 28914 leader_election.cc:302] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.563970 29167 raft_consensus.cc:2781] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.563673 29149 raft_consensus.cc:348] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.564476 29167 raft_consensus.cc:686] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:42.564678 29149 raft_consensus.cc:374] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.565150 29149 raft_consensus.cc:729] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.565359 29167 consensus_queue.cc:237] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.566073 29149 consensus_queue.cc:260] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.560976 29158 leader_election.cc:288] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.568653 29149 ts_tablet_manager.cc:1428] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 15:08:42.569970 29149 tablet_bootstrap.cc:492] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.575495 29147 tablet_bootstrap.cc:654] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.582953 29149 tablet_bootstrap.cc:654] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.583873 29150 tablet_bootstrap.cc:492] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.584570 29150 ts_tablet_manager.cc:1397] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.090s user 0.012s sys 0.009s
I20260807 15:08:42.588394 29147 tablet_bootstrap.cc:492] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.589108 29147 ts_tablet_manager.cc:1397] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.053s user 0.018s sys 0.001s
I20260807 15:08:42.589291 29150 raft_consensus.cc:348] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.590570 29150 raft_consensus.cc:374] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.591024 29150 raft_consensus.cc:729] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.594765 29147 raft_consensus.cc:348] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.595960 29147 raft_consensus.cc:374] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.596377 29147 raft_consensus.cc:729] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.597221 29147 consensus_queue.cc:260] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.600704 29155 raft_consensus.cc:482] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.601383 29155 raft_consensus.cc:504] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.610194 29147 ts_tablet_manager.cc:1428] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.021s user 0.009s sys 0.000s
I20260807 15:08:42.614521 29155 leader_election.cc:288] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:42.621563 29147 tablet_bootstrap.cc:492] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.624742 29149 tablet_bootstrap.cc:492] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.625304 29149 ts_tablet_manager.cc:1397] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.056s user 0.036s sys 0.011s
I20260807 15:08:42.595252 29150 consensus_queue.cc:260] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.629468 29147 tablet_bootstrap.cc:654] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.628103 29149 raft_consensus.cc:348] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.630697 29149 raft_consensus.cc:374] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.631006 29149 raft_consensus.cc:729] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.631747 29149 consensus_queue.cc:260] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.634326 29149 ts_tablet_manager.cc:1428] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 15:08:42.635481 29149 tablet_bootstrap.cc:492] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.642593 29149 tablet_bootstrap.cc:654] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.643661 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:42.644399 29106 raft_consensus.cc:2454] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 0.
I20260807 15:08:42.645823 28992 leader_election.cc:302] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:42.646752 29158 raft_consensus.cc:2781] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.647275 29158 raft_consensus.cc:482] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.647693 29158 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.648727 29167 raft_consensus.cc:482] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.649402 29167 raft_consensus.cc:504] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.655049 29167 leader_election.cc:288] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.658238 29158 raft_consensus.cc:504] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.661222 29147 tablet_bootstrap.cc:492] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.661829 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:42.662250 29025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:42.662588 29106 raft_consensus.cc:2454] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 0.
I20260807 15:08:42.661819 29147 ts_tablet_manager.cc:1397] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.011s
I20260807 15:08:42.663506 29149 tablet_bootstrap.cc:492] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.662813 29150 ts_tablet_manager.cc:1428] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.047s user 0.008s sys 0.002s
I20260807 15:08:42.666365 29158 leader_election.cc:288] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
W20260807 15:08:42.663756 28912 leader_election.cc:341] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.663982 29149 ts_tablet_manager.cc:1397] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.029s user 0.015s sys 0.003s
I20260807 15:08:42.667462 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:42.668120 29106 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.665535 29147 raft_consensus.cc:348] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.669740 29149 raft_consensus.cc:348] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.670250 29147 raft_consensus.cc:374] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.670428 29149 raft_consensus.cc:374] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.670529 29147 raft_consensus.cc:729] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.670730 29149 raft_consensus.cc:729] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.671173 29147 consensus_queue.cc:260] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.671319 29149 consensus_queue.cc:260] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.673369 29158 raft_consensus.cc:482] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.673800 29158 raft_consensus.cc:504] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.673800 29149 ts_tablet_manager.cc:1428] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:08:42.677400 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:42.678081 29103 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 0.
I20260807 15:08:42.678002 28914 leader_election.cc:302] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.679497 28992 leader_election.cc:302] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:42.678083 29149 tablet_bootstrap.cc:492] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63: Bootstrap starting.
I20260807 15:08:42.682206 29147 ts_tablet_manager.cc:1428] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.019s user 0.002s sys 0.003s
I20260807 15:08:42.680311 29154 raft_consensus.cc:2781] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.686849 29154 raft_consensus.cc:482] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.687351 29154 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.701278 29167 raft_consensus.cc:482] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.701853 29167 raft_consensus.cc:504] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.704861 29167 leader_election.cc:288] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.706576 28949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:42.708086 28948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:42.708886 28948 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 0.
I20260807 15:08:42.710057 29025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebf88fa06c3f4acabe37f641d007ff54" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
W20260807 15:08:42.711547 28912 leader_election.cc:341] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.705241 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:42.706406 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebf88fa06c3f4acabe37f641d007ff54" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:42.713131 29106 raft_consensus.cc:2454] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 1.
I20260807 15:08:42.713529 29103 raft_consensus.cc:2454] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 0.
W20260807 15:08:42.713552 28990 leader_election.cc:341] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:08:42.715842 28990 leader_election.cc:341] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.718926 28914 leader_election.cc:302] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.720505 29150 tablet_bootstrap.cc:492] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.720784 29167 raft_consensus.cc:2781] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.721827 29167 raft_consensus.cc:482] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.722612 29167 raft_consensus.cc:3037] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.678164 29158 leader_election.cc:288] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.724449 29158 raft_consensus.cc:2781] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.724925 29158 raft_consensus.cc:482] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.725353 29158 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:08:42.728890 28992 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:46027, user_credentials={real_user=slave}} blocked reactor thread for 49481.2us
I20260807 15:08:42.732756 28992 leader_election.cc:302] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters: a26048c84be94fb488a146f9d1205b63
I20260807 15:08:42.732048 29147 tablet_bootstrap.cc:492] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.733474 29154 raft_consensus.cc:504] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.735495 29186 raft_consensus.cc:2781] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.736922 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:42.737591 29103 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.738569 29025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
W20260807 15:08:42.740159 28912 leader_election.cc:341] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.741276 28839 catalog_manager.cc:5495] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 1 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:42.743628 28839 catalog_manager.cc:5495] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 1 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:42.745239 29103 raft_consensus.cc:2454] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 1.
I20260807 15:08:42.746480 28914 leader_election.cc:302] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.747879 29166 raft_consensus.cc:2781] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.749832 29149 tablet_bootstrap.cc:654] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.752313 29150 tablet_bootstrap.cc:654] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.755097 29155 raft_consensus.cc:482] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.755652 29155 raft_consensus.cc:504] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.756722 29147 tablet_bootstrap.cc:654] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.758010 29155 leader_election.cc:288] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091)
I20260807 15:08:42.735711 29154 leader_election.cc:288] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.757947 29186 raft_consensus.cc:686] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:42.751824 29167 raft_consensus.cc:504] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.744940 29158 raft_consensus.cc:504] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.762923 29158 leader_election.cc:288] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.764213 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:42.764891 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:42.765439 28950 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.765508 29103 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.761029 29166 raft_consensus.cc:686] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:42.771066 29166 consensus_queue.cc:237] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.771723 29187 raft_consensus.cc:482] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.772519 29149 tablet_bootstrap.cc:492] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63: No bootstrap required, opened a new log
I20260807 15:08:42.772233 29187 raft_consensus.cc:504] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.773171 29149 ts_tablet_manager.cc:1397] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63: Time spent bootstrapping tablet: real 0.095s user 0.012s sys 0.001s
I20260807 15:08:42.776757 29025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebf88fa06c3f4acabe37f641d007ff54" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:42.778652 28948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebf88fa06c3f4acabe37f641d007ff54" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:42.778678 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebf88fa06c3f4acabe37f641d007ff54" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:42.779276 28949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:42.779510 29106 raft_consensus.cc:3037] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.779657 28948 raft_consensus.cc:2379] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eec748acf34c16a0ef093057a3870a in current term 1: Already voted for candidate a26048c84be94fb488a146f9d1205b63 in this term.
I20260807 15:08:42.779985 28949 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 0.
I20260807 15:08:42.766484 29186 consensus_queue.cc:237] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.777413 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:42.784729 29149 raft_consensus.cc:348] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.785306 29149 raft_consensus.cc:374] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.785522 29149 raft_consensus.cc:729] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Initialized, Role: FOLLOWER
W20260807 15:08:42.789994 29067 leader_election.cc:341] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.788880 29149 consensus_queue.cc:260] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
W20260807 15:08:42.796770 29067 leader_election.cc:341] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.797405 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebf88fa06c3f4acabe37f641d007ff54" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:42.799612 29187 leader_election.cc:288] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.800565 28949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:42.801770 29149 ts_tablet_manager.cc:1428] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260807 15:08:42.778095 29167 leader_election.cc:288] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.803272 28949 raft_consensus.cc:2454] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 0.
I20260807 15:08:42.803407 29067 leader_election.cc:302] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4, a26048c84be94fb488a146f9d1205b63
I20260807 15:08:42.804364 29106 raft_consensus.cc:2454] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 1.
I20260807 15:08:42.805233 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
W20260807 15:08:42.806681 28912 leader_election.cc:341] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.806840 28990 leader_election.cc:302] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, a26048c84be94fb488a146f9d1205b63; no voters:
I20260807 15:08:42.807413 28914 leader_election.cc:302] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.808444 29155 raft_consensus.cc:2726] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:42.808490 29187 raft_consensus.cc:2781] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.809166 29187 raft_consensus.cc:482] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.809634 29187 raft_consensus.cc:3037] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:08:42.809893 28992 leader_election.cc:341] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.810032 29103 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 1.
I20260807 15:08:42.811332 28992 leader_election.cc:302] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:42.812264 29158 raft_consensus.cc:2781] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.812477 28950 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 1.
I20260807 15:08:42.813843 29167 raft_consensus.cc:2781] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.812181 29067 leader_election.cc:302] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.815321 29147 tablet_bootstrap.cc:492] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.815758 29147 ts_tablet_manager.cc:1397] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.084s user 0.015s sys 0.001s
I20260807 15:08:42.816345 29150 tablet_bootstrap.cc:492] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.818333 29155 raft_consensus.cc:2781] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.827404 29155 raft_consensus.cc:482] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.827986 29155 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.828255 29187 raft_consensus.cc:504] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.814932 29167 raft_consensus.cc:686] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:42.832398 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:42.833257 28950 raft_consensus.cc:3037] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.832901 29167 consensus_queue.cc:237] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.843371 28950 raft_consensus.cc:2454] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 1.
I20260807 15:08:42.845321 28990 leader_election.cc:302] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, a26048c84be94fb488a146f9d1205b63; no voters:
I20260807 15:08:42.846228 29186 raft_consensus.cc:2781] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.843309 29155 raft_consensus.cc:504] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.847263 29187 leader_election.cc:288] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.847261 28838 catalog_manager.cc:5495] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 1 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:42.848785 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:42.849452 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:42.850350 29155 leader_election.cc:288] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091)
I20260807 15:08:42.843690 29150 ts_tablet_manager.cc:1397] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.123s user 0.019s sys 0.000s
W20260807 15:08:42.850838 28992 leader_election.cc:341] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.851114 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:42.826097 29147 raft_consensus.cc:348] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.846834 29186 raft_consensus.cc:686] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:42.852816 28950 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:08:42.851478 29067 leader_election.cc:341] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.853600 29186 consensus_queue.cc:237] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.858839 29147 raft_consensus.cc:374] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.859243 29147 raft_consensus.cc:729] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.860106 29147 consensus_queue.cc:260] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.862880 29147 ts_tablet_manager.cc:1428] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
I20260807 15:08:42.863468 29158 raft_consensus.cc:686] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:42.863996 29147 tablet_bootstrap.cc:492] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a: Bootstrap starting.
I20260807 15:08:42.864466 29158 consensus_queue.cc:237] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.866571 29150 raft_consensus.cc:348] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.869771 29155 raft_consensus.cc:482] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.870613 29155 raft_consensus.cc:504] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.872225 29147 tablet_bootstrap.cc:654] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.874147 28949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:42.874933 28949 raft_consensus.cc:2454] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 0.
I20260807 15:08:42.876428 29067 leader_election.cc:302] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:42.880640 29155 leader_election.cc:288] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:42.882629 29155 raft_consensus.cc:2781] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.885533 29155 raft_consensus.cc:482] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.886723 29155 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.884645 28950 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 1.
I20260807 15:08:42.885087 29147 tablet_bootstrap.cc:492] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a: No bootstrap required, opened a new log
I20260807 15:08:42.893435 29147 ts_tablet_manager.cc:1397] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a: Time spent bootstrapping tablet: real 0.030s user 0.013s sys 0.007s
I20260807 15:08:42.896008 29147 raft_consensus.cc:348] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.896739 29147 raft_consensus.cc:374] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.897014 29147 raft_consensus.cc:729] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.897464 29067 leader_election.cc:302] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.897890 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:42.898562 29147 consensus_queue.cc:260] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.903704 29205 raft_consensus.cc:2781] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election won for term 1
W20260807 15:08:42.904059 29067 leader_election.cc:341] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.904194 29147 ts_tablet_manager.cc:1428] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 15:08:42.899653 29155 raft_consensus.cc:504] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.870188 29150 raft_consensus.cc:374] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.907680 29150 raft_consensus.cc:729] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.908114 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:42.908768 28950 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.908841 29150 consensus_queue.cc:260] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.911957 29150 ts_tablet_manager.cc:1428] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.055s user 0.007s sys 0.001s
I20260807 15:08:42.912542 29205 raft_consensus.cc:686] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Becoming Leader. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:42.913519 29205 consensus_queue.cc:237] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.915011 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
W20260807 15:08:42.916445 29067 leader_election.cc:341] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.917076 29155 leader_election.cc:288] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:42.917951 28838 catalog_manager.cc:5495] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 1 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:42.918627 29150 tablet_bootstrap.cc:492] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.919514 28838 catalog_manager.cc:5495] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 1 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:42.922123 28950 raft_consensus.cc:2454] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 1.
I20260807 15:08:42.923581 29067 leader_election.cc:302] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.924494 29205 raft_consensus.cc:2781] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.925001 29205 raft_consensus.cc:686] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Becoming Leader. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:42.925802 29205 consensus_queue.cc:237] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.927163 29150 tablet_bootstrap.cc:654] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.930426 28839 catalog_manager.cc:5495] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 1 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:42.932401 28839 catalog_manager.cc:5495] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 1 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:42.939821 29150 tablet_bootstrap.cc:492] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.940327 29150 ts_tablet_manager.cc:1397] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.004s
I20260807 15:08:42.942446 29150 raft_consensus.cc:348] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.943177 29150 raft_consensus.cc:374] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.943463 29150 raft_consensus.cc:729] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.944139 29150 consensus_queue.cc:260] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.946480 29150 ts_tablet_manager.cc:1428] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260807 15:08:42.947449 29150 tablet_bootstrap.cc:492] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.949435 28839 catalog_manager.cc:5495] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eec748acf34c16a0ef093057a3870a (127.27.144.195). New cstate: current_term: 1 leader_uuid: "b8eec748acf34c16a0ef093057a3870a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:42.951637 28839 catalog_manager.cc:5495] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eec748acf34c16a0ef093057a3870a (127.27.144.195). New cstate: current_term: 1 leader_uuid: "b8eec748acf34c16a0ef093057a3870a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:42.954133 29150 tablet_bootstrap.cc:654] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.960582 29150 tablet_bootstrap.cc:492] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.960635 29167 raft_consensus.cc:482] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:42.961143 29150 ts_tablet_manager.cc:1397] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260807 15:08:42.961328 29167 raft_consensus.cc:504] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
W20260807 15:08:42.960785 28912 consensus_peers.cc:487] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 -> Peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Couldn't send request to peer 2e170a81ade34927b5e90c5fb90700e4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:08:42.963413 29150 raft_consensus.cc:348] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.964282 29150 raft_consensus.cc:374] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.964594 29167 leader_election.cc:288] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.964627 29150 raft_consensus.cc:729] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.965279 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:42.965618 29150 consensus_queue.cc:260] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.964744 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
W20260807 15:08:42.966542 28912 leader_election.cc:341] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.966634 29103 raft_consensus.cc:2454] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 0.
I20260807 15:08:42.967833 29150 ts_tablet_manager.cc:1428] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:08:42.967921 28914 leader_election.cc:302] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.969125 29150 tablet_bootstrap.cc:492] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.970489 29167 raft_consensus.cc:2781] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:08:42.970916 29167 raft_consensus.cc:482] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:08:42.971282 29167 raft_consensus.cc:3037] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:42.975584 29150 tablet_bootstrap.cc:654] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.979944 29167 raft_consensus.cc:504] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.980510 29150 tablet_bootstrap.cc:492] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.981099 29150 ts_tablet_manager.cc:1397] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260807 15:08:42.982545 29167 leader_election.cc:288] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:42.982950 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:42.983144 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:42.983767 29103 raft_consensus.cc:3037] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:08:42.984205 28912 leader_election.cc:341] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:08:42.983886 29150 raft_consensus.cc:348] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.984661 29150 raft_consensus.cc:374] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:42.984905 29150 raft_consensus.cc:729] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:42.985486 29150 consensus_queue.cc:260] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:42.987138 29150 ts_tablet_manager.cc:1428] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:08:42.988256 29150 tablet_bootstrap.cc:492] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:42.989711 29103 raft_consensus.cc:2454] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 1.
I20260807 15:08:42.990808 28914 leader_election.cc:302] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:42.991600 29167 raft_consensus.cc:2781] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:08:42.992090 29167 raft_consensus.cc:686] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:42.992795 29150 tablet_bootstrap.cc:654] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:42.992866 29167 consensus_queue.cc:237] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:42.997926 29150 tablet_bootstrap.cc:492] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:42.998353 29150 ts_tablet_manager.cc:1397] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 15:08:43.000542 29150 raft_consensus.cc:348] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.001030 29150 raft_consensus.cc:374] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:43.001245 29150 raft_consensus.cc:729] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:43.001786 29150 consensus_queue.cc:260] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.003695 29150 ts_tablet_manager.cc:1428] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260807 15:08:43.004734 29150 tablet_bootstrap.cc:492] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4: Bootstrap starting.
I20260807 15:08:43.004391 28841 catalog_manager.cc:5495] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 1 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:43.010594 29150 tablet_bootstrap.cc:654] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:08:43.015516 29150 tablet_bootstrap.cc:492] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4: No bootstrap required, opened a new log
I20260807 15:08:43.015996 29150 ts_tablet_manager.cc:1397] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4: Time spent bootstrapping tablet: real 0.011s user 0.011s sys 0.000s
I20260807 15:08:43.016072 29167 consensus_queue.cc:1035] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:43.018256 29150 raft_consensus.cc:348] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.018864 29150 raft_consensus.cc:374] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:08:43.019083 29150 raft_consensus.cc:729] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Initialized, Role: FOLLOWER
I20260807 15:08:43.019632 29150 consensus_queue.cc:260] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.021317 29150 ts_tablet_manager.cc:1428] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 15:08:43.023644 29158 raft_consensus.cc:482] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:43.024199 29158 raft_consensus.cc:504] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.025959 29158 leader_election.cc:288] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.026600 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:43.027036 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:43.027390 28950 raft_consensus.cc:2379] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e170a81ade34927b5e90c5fb90700e4 in current term 1: Already voted for candidate b8eec748acf34c16a0ef093057a3870a in this term.
I20260807 15:08:43.028530 28992 leader_election.cc:302] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4; no voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:43.029289 29158 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:43.036087 29158 raft_consensus.cc:2726] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:43.048945 29158 raft_consensus.cc:482] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:43.049352 29158 raft_consensus.cc:504] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.050830 29158 leader_election.cc:288] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.051707 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebf88fa06c3f4acabe37f641d007ff54" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:43.051826 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebf88fa06c3f4acabe37f641d007ff54" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:43.052627 29102 raft_consensus.cc:2379] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e170a81ade34927b5e90c5fb90700e4 in current term 1: Already voted for candidate a26048c84be94fb488a146f9d1205b63 in this term.
I20260807 15:08:43.053555 28992 leader_election.cc:302] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4; no voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:43.054258 29158 raft_consensus.cc:3037] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:43.058743 29158 raft_consensus.cc:2726] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:43.065604 29190 raft_consensus.cc:482] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:43.066053 29190 raft_consensus.cc:504] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.067967 29190 leader_election.cc:288] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.068724 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:43.068912 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:43.069690 29102 raft_consensus.cc:2379] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a26048c84be94fb488a146f9d1205b63 in current term 1: Already voted for candidate 2e170a81ade34927b5e90c5fb90700e4 in this term.
I20260807 15:08:43.070593 28914 leader_election.cc:302] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a26048c84be94fb488a146f9d1205b63; no voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:43.071275 29190 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:43.075955 29190 raft_consensus.cc:2726] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:43.097875 29190 consensus_queue.cc:1035] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.108764 29190 consensus_queue.cc:1035] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.116227 29158 raft_consensus.cc:482] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:43.116684 29158 raft_consensus.cc:504] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.118513 29158 leader_election.cc:288] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.119217 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:43.119625 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:43.120496 29102 raft_consensus.cc:2379] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e170a81ade34927b5e90c5fb90700e4 in current term 1: Already voted for candidate a26048c84be94fb488a146f9d1205b63 in this term.
I20260807 15:08:43.121594 28992 leader_election.cc:302] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4; no voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:43.122288 29158 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:43.128692 29158 raft_consensus.cc:2726] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:43.195809 29102 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
mode: GRACEFUL
new_leader_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:39650
I20260807 15:08:43.196503 29102 raft_consensus.cc:595] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Received request to transfer leadership to TS a26048c84be94fb488a146f9d1205b63
I20260807 15:08:43.213841 29026 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
mode: GRACEFUL
new_leader_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:47106
I20260807 15:08:43.214546 29026 raft_consensus.cc:595] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Received request to transfer leadership to TS a26048c84be94fb488a146f9d1205b63
I20260807 15:08:43.216540 29158 consensus_queue.cc:1035] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.219964 29026 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bd9a7e182d834b58926232f982697295"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
mode: GRACEFUL
new_leader_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:47106
I20260807 15:08:43.220530 29026 raft_consensus.cc:595] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Received request to transfer leadership to TS a26048c84be94fb488a146f9d1205b63
I20260807 15:08:43.224203 29186 raft_consensus.cc:979] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4: : Instructing follower a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:43.224680 29186 raft_consensus.cc:1067] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Signalling peer a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:43.227532 28949 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:50392
I20260807 15:08:43.229265 28949 raft_consensus.cc:482] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:43.229722 28949 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.230643 29187 raft_consensus.cc:482] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:43.231139 29187 raft_consensus.cc:504] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.231757 29198 consensus_queue.cc:1035] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:43.233207 29187 leader_election.cc:288] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.234870 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:43.235677 29103 raft_consensus.cc:2379] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e170a81ade34927b5e90c5fb90700e4 in current term 1: Already voted for candidate a26048c84be94fb488a146f9d1205b63 in this term.
I20260807 15:08:43.235757 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:43.237520 28990 leader_election.cc:302] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4; no voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:43.238763 29187 raft_consensus.cc:3037] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:43.239394 28949 raft_consensus.cc:504] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.239719 29103 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
mode: GRACEFUL
new_leader_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:39650
I20260807 15:08:43.240584 29103 raft_consensus.cc:595] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Received request to transfer leadership to TS 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:43.246773 29187 raft_consensus.cc:2726] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:43.248039 29205 raft_consensus.cc:482] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:43.248549 29205 raft_consensus.cc:504] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.250988 29205 leader_election.cc:288] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:43.254050 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e170a81ade34927b5e90c5fb90700e4" is_pre_election: true
I20260807 15:08:43.259665 29190 consensus_queue.cc:1035] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.261430 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:43.262274 28950 raft_consensus.cc:2379] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eec748acf34c16a0ef093057a3870a in current term 1: Already voted for candidate 2e170a81ade34927b5e90c5fb90700e4 in this term.
I20260807 15:08:43.263561 29067 leader_election.cc:302] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8eec748acf34c16a0ef093057a3870a; no voters: 2e170a81ade34927b5e90c5fb90700e4, a26048c84be94fb488a146f9d1205b63
I20260807 15:08:43.263834 29190 consensus_queue.cc:1035] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.266283 28948 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:50412
I20260807 15:08:43.267012 28948 raft_consensus.cc:595] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Received request to transfer leadership to TS 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:43.264822 29205 raft_consensus.cc:3037] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:43.274425 28948 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a55e7cb8d220466985728925e97bab75"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:50412
I20260807 15:08:43.275044 28948 raft_consensus.cc:595] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Received request to transfer leadership to TS 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:43.285125 29166 raft_consensus.cc:979] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63: : Instructing follower 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:08:43.285651 29166 raft_consensus.cc:1067] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Signalling peer 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:08:43.288262 28948 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:50412
I20260807 15:08:43.288945 28948 raft_consensus.cc:595] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Received request to transfer leadership to TS 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:43.293370 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:43.293605 29025 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:47092
I20260807 15:08:43.293994 29102 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.294528 29024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:43.295159 29024 raft_consensus.cc:3032] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:43.295477 29024 raft_consensus.cc:729] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:43.296271 29024 consensus_queue.cc:260] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.297480 29024 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.297857 29205 raft_consensus.cc:2726] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:43.298535 28949 leader_election.cc:288] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 2 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.301425 29158 consensus_queue.cc:1035] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.302847 29023 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
mode: GRACEFUL
new_leader_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:47106
I20260807 15:08:43.303527 29023 raft_consensus.cc:595] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Received request to transfer leadership to TS b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:43.301328 29166 consensus_queue.cc:1035] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:43.304960 29102 raft_consensus.cc:2454] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 2.
I20260807 15:08:43.307693 29025 raft_consensus.cc:482] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:43.308378 29025 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.307585 28914 leader_election.cc:302] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:43.310839 29167 raft_consensus.cc:2781] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:43.311388 29167 raft_consensus.cc:686] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:43.312363 29167 consensus_queue.cc:237] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.313555 29158 consensus_queue.cc:1035] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.321367 29025 raft_consensus.cc:504] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.329277 29186 consensus_queue.cc:1035] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.329598 29024 raft_consensus.cc:2454] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 2.
I20260807 15:08:43.334103 29025 leader_election.cc:288] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 2 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.334014 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:43.334872 28950 raft_consensus.cc:3032] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:43.335246 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:43.335251 28950 raft_consensus.cc:729] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:43.335938 29106 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.336521 28950 consensus_queue.cc:260] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.337874 28950 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.343624 29106 raft_consensus.cc:2454] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 2.
I20260807 15:08:43.333923 29026 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:43.345399 29166 consensus_queue.cc:1035] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:43.350666 28992 leader_election.cc:302] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:43.351821 29198 raft_consensus.cc:2781] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:43.352415 29198 raft_consensus.cc:686] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:43.353287 29198 consensus_queue.cc:237] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.359447 29205 consensus_queue.cc:1035] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:43.360175 28838 catalog_manager.cc:5495] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 1 to 2, leader changed from 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194) to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 2 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:43.373076 29198 consensus_queue.cc:1035] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.378386 28950 raft_consensus.cc:2454] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 2.
I20260807 15:08:43.383819 29205 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:43.405804 29206 raft_consensus.cc:979] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a: : Instructing follower 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:08:43.407848 29206 raft_consensus.cc:1067] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Signalling peer 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:08:43.406512 29158 raft_consensus.cc:979] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4: : Instructing follower a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:43.410383 29158 raft_consensus.cc:1067] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Signalling peer a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:43.412598 28950 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bd9a7e182d834b58926232f982697295"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:50392
I20260807 15:08:43.413211 28950 raft_consensus.cc:482] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:43.413610 28950 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.414348 29206 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:43.414451 28838 catalog_manager.cc:5495] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 1 to 2, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 2 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:43.419485 29205 consensus_queue.cc:1035] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.419822 29190 consensus_queue.cc:1035] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:08:43.423086 29158 raft_consensus.cc:482] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:08:43.423602 29158 raft_consensus.cc:504] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.425521 29198 raft_consensus.cc:979] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4: : Instructing follower b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:08:43.426018 29198 raft_consensus.cc:1067] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Signalling peer b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:08:43.427872 28946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26048c84be94fb488a146f9d1205b63" is_pre_election: true
I20260807 15:08:43.429044 29103 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:39648
I20260807 15:08:43.430178 29103 raft_consensus.cc:482] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:43.430583 29103 raft_consensus.cc:3037] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.430748 29158 leader_election.cc:288] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.422610 28950 raft_consensus.cc:504] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.432217 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eec748acf34c16a0ef093057a3870a" is_pre_election: true
I20260807 15:08:43.435479 29026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:43.436358 29026 raft_consensus.cc:3032] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:43.436806 29026 raft_consensus.cc:729] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:43.437881 28992 leader_election.cc:302] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4; no voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:43.438035 29026 consensus_queue.cc:260] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.440594 29026 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.453065 29205 raft_consensus.cc:979] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a: : Instructing follower a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:43.455571 29205 raft_consensus.cc:1067] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Signalling peer a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:43.446772 29025 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:47102
I20260807 15:08:43.457243 29025 raft_consensus.cc:482] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:43.457652 29025 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.458616 28948 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:50404
I20260807 15:08:43.459178 28948 raft_consensus.cc:482] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:43.459540 28948 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.449852 29187 raft_consensus.cc:2726] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:08:43.466629 29103 raft_consensus.cc:504] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.468060 28948 raft_consensus.cc:504] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:43.469791 28950 leader_election.cc:288] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 2 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.470744 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:43.471411 29106 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.475507 29026 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 2.
I20260807 15:08:43.478397 29106 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 2.
I20260807 15:08:43.480082 28914 leader_election.cc:302] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:43.481103 29166 raft_consensus.cc:2781] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:43.481578 29166 raft_consensus.cc:686] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:43.482419 29166 consensus_queue.cc:237] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.483407 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:43.484040 29106 raft_consensus.cc:3032] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:43.484385 29106 raft_consensus.cc:729] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:43.485142 29106 consensus_queue.cc:260] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:43.486372 29106 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.489605 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:43.490543 28950 raft_consensus.cc:3037] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.491959 29023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd3401a06dd34713843f26f578012f0e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:43.492590 29023 raft_consensus.cc:3032] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:43.492905 29023 raft_consensus.cc:729] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:43.493906 29106 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 2.
I20260807 15:08:43.493665 29023 consensus_queue.cc:260] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.494908 29023 raft_consensus.cc:3037] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.495115 28914 leader_election.cc:302] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:43.496191 29166 raft_consensus.cc:2781] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:43.497092 29166 raft_consensus.cc:686] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:43.497934 29166 consensus_queue.cc:237] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:43.502503 28948 leader_election.cc:288] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 2 election: Requested vote from peers b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:43.503561 29166 consensus_queue.cc:1035] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.505237 29024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:43.505913 29024 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.512982 29229 raft_consensus.cc:979] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63: : Instructing follower 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:08:43.513592 29229 raft_consensus.cc:1067] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Signalling peer 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:08:43.516781 29024 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 2.
I20260807 15:08:43.517776 29021 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:47092
I20260807 15:08:43.518433 29021 raft_consensus.cc:482] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:43.518824 29021 raft_consensus.cc:3037] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.521127 28950 raft_consensus.cc:2454] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 2.
I20260807 15:08:43.522244 29023 raft_consensus.cc:2454] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 2.
I20260807 15:08:43.522519 29067 leader_election.cc:302] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:43.524493 29103 leader_election.cc:288] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 2 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:43.524569 29205 raft_consensus.cc:2781] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:43.525285 29205 raft_consensus.cc:686] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 2 LEADER]: Becoming Leader. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:43.526474 29205 consensus_queue.cc:237] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.531363 29021 raft_consensus.cc:504] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.536561 28839 catalog_manager.cc:5495] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a reported cstate change: term changed from 1 to 2, leader changed from 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194) to b8eec748acf34c16a0ef093057a3870a (127.27.144.195). New cstate: current_term: 2 leader_uuid: "b8eec748acf34c16a0ef093057a3870a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:43.537536 29022 raft_consensus.cc:1226] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Rejecting Update request from peer a26048c84be94fb488a146f9d1205b63 for earlier term 1. Current term is 2. Ops: []
I20260807 15:08:43.478430 29025 raft_consensus.cc:504] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.541400 29190 consensus_queue.cc:1046] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:08:43.542757 29190 raft_consensus.cc:3032] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:43.543128 29190 raft_consensus.cc:729] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:43.544296 29190 consensus_queue.cc:260] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.545254 29190 raft_consensus.cc:3037] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.545529 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:43.547149 29025 leader_election.cc:288] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 2 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.547251 28948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d542463930bb44b095447ed9e2f2b745" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:43.548277 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:43.546283 29021 leader_election.cc:288] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 2 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.555107 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:43.555764 29103 raft_consensus.cc:3032] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:43.558027 29103 raft_consensus.cc:729] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:43.558985 29103 consensus_queue.cc:260] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.560391 29103 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.562472 28838 catalog_manager.cc:5495] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 1 to 2, leader changed from 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194) to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 2 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:43.567554 29103 raft_consensus.cc:2454] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 2.
I20260807 15:08:43.568764 29021 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:08:43.569141 28992 leader_election.cc:302] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters: a26048c84be94fb488a146f9d1205b63
I20260807 15:08:43.570365 29187 raft_consensus.cc:2781] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:43.570865 29187 raft_consensus.cc:686] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:43.571763 29187 consensus_queue.cc:237] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.567485 28948 raft_consensus.cc:2454] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 2.
I20260807 15:08:43.580013 28990 leader_election.cc:302] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, a26048c84be94fb488a146f9d1205b63; no voters: b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:43.582038 29187 raft_consensus.cc:2781] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:43.582789 29187 raft_consensus.cc:686] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:43.583582 29187 consensus_queue.cc:237] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.584940 28838 catalog_manager.cc:5495] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 1 to 2, leader changed from b8eec748acf34c16a0ef093057a3870a (127.27.144.195) to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 2 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:43.592084 29166 raft_consensus.cc:979] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63: : Instructing follower 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:08:43.592614 29190 raft_consensus.cc:1067] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Signalling peer 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:08:43.594241 29021 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a55e7cb8d220466985728925e97bab75"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:47092
I20260807 15:08:43.594746 29021 raft_consensus.cc:482] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:43.595057 29021 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.597595 28839 catalog_manager.cc:5495] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 1 to 2, leader changed from b8eec748acf34c16a0ef093057a3870a (127.27.144.195) to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 2 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:43.599941 29021 raft_consensus.cc:504] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.602726 28948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:43.603291 28948 raft_consensus.cc:3032] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:43.603611 28948 raft_consensus.cc:729] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:43.603739 29021 leader_election.cc:288] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 2 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:43.605590 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:43.606205 29103 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.604491 28948 consensus_queue.cc:260] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.609325 28948 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.612390 28838 catalog_manager.cc:5495] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 1 to 2, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 2 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:43.613549 29103 raft_consensus.cc:2454] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 2.
I20260807 15:08:43.614790 28992 leader_election.cc:302] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:43.615630 29187 raft_consensus.cc:2781] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:43.616205 29187 raft_consensus.cc:686] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:43.616456 28948 raft_consensus.cc:2454] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 2.
I20260807 15:08:43.617151 29187 consensus_queue.cc:237] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:43.627164 28838 catalog_manager.cc:5495] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 1 to 2, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 2 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:43.824568 28948 raft_consensus.cc:1261] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:43.825999 29187 consensus_queue.cc:1035] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:43.833557 29103 raft_consensus.cc:1261] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:43.835219 29158 consensus_queue.cc:1035] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:43.852545 29103 raft_consensus.cc:1261] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:43.853993 29229 consensus_queue.cc:1035] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:43.861817 29021 raft_consensus.cc:1261] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:43.863165 29229 consensus_queue.cc:1035] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:43.964026 29021 raft_consensus.cc:1261] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:43.965569 29229 consensus_queue.cc:1035] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:43.973869 29103 raft_consensus.cc:1261] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:43.975282 29190 consensus_queue.cc:1035] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:08:43.976315 28948 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:43.985021 28948 raft_consensus.cc:1261] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:43.986464 29158 consensus_queue.cc:1035] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:43.994763 29103 raft_consensus.cc:1261] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:43.996476 29187 consensus_queue.cc:1035] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:44.002782 29021 raft_consensus.cc:1261] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:44.004534 29155 consensus_queue.cc:1035] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:44.014070 28948 raft_consensus.cc:1261] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:44.015489 29155 consensus_queue.cc:1035] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:44.040340 28948 raft_consensus.cc:1261] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:44.041579 29187 consensus_queue.cc:1035] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:44.049140 29103 raft_consensus.cc:3037] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:44.056483 29103 raft_consensus.cc:1261] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:44.057143 29021 raft_consensus.cc:1261] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:44.057930 29187 consensus_queue.cc:1035] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:44.058481 29190 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:44.067734 29103 raft_consensus.cc:1261] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:44.069242 29229 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:44.141985 28948 raft_consensus.cc:1261] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:44.143306 29158 consensus_queue.cc:1035] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:44.144409 29103 raft_consensus.cc:1261] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:08:44.145654 29158 consensus_queue.cc:1035] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:08:46.339089 28227 auto_leader_rebalancer-test.cc:339] The leader distribution is
I20260807 15:08:46.339788 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:46.359781 28948 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:50422
I20260807 15:08:46.360478 28948 raft_consensus.cc:595] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Received request to transfer leadership to TS b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:46.363154 28948 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bd9a7e182d834b58926232f982697295"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:50422
I20260807 15:08:46.363848 28948 raft_consensus.cc:595] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Received request to transfer leadership to TS b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:46.364899 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 15:08:46.365387 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:46.498158 29229 raft_consensus.cc:979] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63: : Instructing follower b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:08:46.498679 29229 raft_consensus.cc:1067] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Signalling peer b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:08:46.500058 29103 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:39636
I20260807 15:08:46.500552 29103 raft_consensus.cc:482] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:46.500836 29103 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:46.504966 29103 raft_consensus.cc:504] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:46.506466 29103 leader_election.cc:288] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 3 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091)
I20260807 15:08:46.507273 29021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:46.507812 29021 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:46.508442 28948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:46.509040 28948 raft_consensus.cc:3032] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:46.509354 28948 raft_consensus.cc:729] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:46.509991 28948 consensus_queue.cc:260] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:46.510938 28948 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:46.512959 29021 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 3.
I20260807 15:08:46.513986 29067 leader_election.cc:302] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:46.514685 29155 raft_consensus.cc:2781] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:46.515548 28948 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 3.
I20260807 15:08:46.515874 29155 raft_consensus.cc:686] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Becoming Leader. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:46.516808 29155 consensus_queue.cc:237] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:46.523397 28839 catalog_manager.cc:5495] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a reported cstate change: term changed from 2 to 3, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to b8eec748acf34c16a0ef093057a3870a (127.27.144.195). New cstate: current_term: 3 leader_uuid: "b8eec748acf34c16a0ef093057a3870a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:46.551577 29254 raft_consensus.cc:979] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63: : Instructing follower b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:08:46.552034 29229 raft_consensus.cc:1067] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Signalling peer b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:08:46.553588 29103 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bd9a7e182d834b58926232f982697295"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:39636
I20260807 15:08:46.554123 29103 raft_consensus.cc:482] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:46.554409 29103 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:46.558761 29103 raft_consensus.cc:504] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:46.560189 29103 leader_election.cc:288] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 3 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:46.561204 28948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:46.561553 29021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:46.561810 28948 raft_consensus.cc:3032] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:46.562196 28948 raft_consensus.cc:729] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:46.562235 29021 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:46.563014 28948 consensus_queue.cc:260] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:46.564165 28948 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:46.567797 29021 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 3.
I20260807 15:08:46.569010 29067 leader_election.cc:302] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:46.569427 28948 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 3.
I20260807 15:08:46.569814 29155 raft_consensus.cc:2781] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:46.570389 29155 raft_consensus.cc:686] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Becoming Leader. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:46.571323 29155 consensus_queue.cc:237] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:46.578869 28839 catalog_manager.cc:5495] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a reported cstate change: term changed from 2 to 3, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to b8eec748acf34c16a0ef093057a3870a (127.27.144.195). New cstate: current_term: 3 leader_uuid: "b8eec748acf34c16a0ef093057a3870a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:46.953699 28948 raft_consensus.cc:1261] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:46.954988 29155 consensus_queue.cc:1035] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:46.965073 29021 raft_consensus.cc:1261] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:46.967343 29155 consensus_queue.cc:1035] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:47.119951 29021 raft_consensus.cc:1261] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:47.121368 29155 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:47.130587 28948 raft_consensus.cc:1261] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:47.132177 29255 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:47.366211 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:47.371701 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:47.372191 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:48.673112 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:48.678813 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:48.679343 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260807 15:08:49.589594 29049 debug-util.cc:398] Leaking SignalData structure 0x7b0800106a40 after lost signal to thread 28230
W20260807 15:08:49.590746 29049 debug-util.cc:398] Leaking SignalData structure 0x7b08001040e0 after lost signal to thread 28879
W20260807 15:08:49.591864 29049 debug-util.cc:398] Leaking SignalData structure 0x7b0800054060 after lost signal to thread 28975
W20260807 15:08:49.592911 29049 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba760 after lost signal to thread 29053
W20260807 15:08:49.593824 29049 debug-util.cc:398] Leaking SignalData structure 0x7b0800060f20 after lost signal to thread 29131
I20260807 15:08:49.680540 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:49.685802 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:49.686254 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:50.687115 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:50.692507 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:50.692984 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:51.693800 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:51.699548 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:51.700053 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:52.700920 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:52.706925 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:52.707423 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:53.708556 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:53.715858 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:53.716414 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:54.717291 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:54.724537 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:54.724985 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:55.726048 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:55.731369 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:08:55.731810 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:56.762918 28227 auto_leader_rebalancer-test.cc:358] The leader distribution is
I20260807 15:08:56.768208 29102 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
mode: GRACEFUL
new_leader_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:39650
I20260807 15:08:56.769616 29102 raft_consensus.cc:595] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Received request to transfer leadership to TS a26048c84be94fb488a146f9d1205b63
I20260807 15:08:56.781816 29102 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bd9a7e182d834b58926232f982697295"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
mode: GRACEFUL
new_leader_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:39650
I20260807 15:08:56.782444 29102 raft_consensus.cc:595] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Received request to transfer leadership to TS a26048c84be94fb488a146f9d1205b63
I20260807 15:08:56.790098 29021 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
mode: GRACEFUL
new_leader_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:47106
I20260807 15:08:56.790611 29021 raft_consensus.cc:595] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Received request to transfer leadership to TS a26048c84be94fb488a146f9d1205b63
I20260807 15:08:56.796164 29021 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
mode: GRACEFUL
new_leader_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:47106
I20260807 15:08:56.796741 29021 raft_consensus.cc:595] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Received request to transfer leadership to TS a26048c84be94fb488a146f9d1205b63
I20260807 15:08:56.801604 29021 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a55e7cb8d220466985728925e97bab75"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
mode: GRACEFUL
new_leader_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:47106
I20260807 15:08:56.802167 29021 raft_consensus.cc:595] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Received request to transfer leadership to TS a26048c84be94fb488a146f9d1205b63
I20260807 15:08:56.867985 29282 raft_consensus.cc:979] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4: : Instructing follower a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:56.868678 29276 raft_consensus.cc:1067] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Signalling peer a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:56.870568 28948 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a55e7cb8d220466985728925e97bab75"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:50392
I20260807 15:08:56.871120 28948 raft_consensus.cc:482] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:56.871578 28948 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:56.871775 29283 raft_consensus.cc:979] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a: : Instructing follower a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:56.872570 29280 raft_consensus.cc:1067] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Signalling peer a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:56.874478 28950 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:50404
I20260807 15:08:56.874992 28950 raft_consensus.cc:482] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:56.875315 28950 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:56.878244 28948 raft_consensus.cc:504] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:56.880313 28948 leader_election.cc:288] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 3 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:56.881217 29021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:56.882123 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55e7cb8d220466985728925e97bab75" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:56.882141 29021 raft_consensus.cc:3032] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:56.882808 29021 raft_consensus.cc:729] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:56.882859 29102 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:56.883517 29021 consensus_queue.cc:260] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:56.884593 29021 raft_consensus.cc:3037] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:56.888595 29102 raft_consensus.cc:2454] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 3.
I20260807 15:08:56.881906 28950 raft_consensus.cc:504] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:56.889334 29021 raft_consensus.cc:2454] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 3.
I20260807 15:08:56.890151 28914 leader_election.cc:302] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:56.890671 28950 leader_election.cc:288] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 4 election: Requested vote from peers b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:56.891268 29281 raft_consensus.cc:2781] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:56.892437 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:56.892429 29021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:56.893224 29102 raft_consensus.cc:3032] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:08:56.892794 29281 raft_consensus.cc:686] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:56.893404 29021 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:56.893718 29102 raft_consensus.cc:729] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:56.894418 29281 consensus_queue.cc:237] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:56.894692 29102 consensus_queue.cc:260] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:56.896354 29102 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:56.901638 29021 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 4.
I20260807 15:08:56.903398 28912 leader_election.cc:302] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, a26048c84be94fb488a146f9d1205b63; no voters:
I20260807 15:08:56.904662 29102 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 4.
I20260807 15:08:56.905877 29281 raft_consensus.cc:2781] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:08:56.906517 29281 raft_consensus.cc:686] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 4 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:56.906764 28841 catalog_manager.cc:5495] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 2 to 3, leader changed from 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194) to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 3 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:56.907335 29281 consensus_queue.cc:237] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:08:56.927220 28841 catalog_manager.cc:5495] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 3 to 4, leader changed from b8eec748acf34c16a0ef093057a3870a (127.27.144.195) to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 4 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } }
I20260807 15:08:56.945537 29283 raft_consensus.cc:979] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a: : Instructing follower a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:56.945964 29280 raft_consensus.cc:1067] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Signalling peer a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:56.947597 28950 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bd9a7e182d834b58926232f982697295"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:50404
I20260807 15:08:56.948129 28950 raft_consensus.cc:482] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:56.948493 28950 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:56.953466 28950 raft_consensus.cc:504] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:56.955158 28950 leader_election.cc:288] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 4 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:56.956161 29021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:56.956501 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd9a7e182d834b58926232f982697295" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:56.956912 29021 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:56.957116 29102 raft_consensus.cc:3032] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:08:56.957552 29102 raft_consensus.cc:729] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:56.958297 29102 consensus_queue.cc:260] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:56.959455 29102 raft_consensus.cc:3037] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:08:56.962210 29021 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 4.
I20260807 15:08:56.963402 28912 leader_election.cc:302] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, a26048c84be94fb488a146f9d1205b63; no voters:
I20260807 15:08:56.964424 29281 raft_consensus.cc:2781] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:08:56.965102 29281 raft_consensus.cc:686] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 4 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:56.966046 29281 consensus_queue.cc:237] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:56.966041 29102 raft_consensus.cc:2454] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 4.
I20260807 15:08:56.975234 28841 catalog_manager.cc:5495] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 3 to 4, leader changed from b8eec748acf34c16a0ef093057a3870a (127.27.144.195) to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 4 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:57.064407 29276 raft_consensus.cc:979] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4: : Instructing follower a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:57.064913 29282 raft_consensus.cc:1067] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Signalling peer a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:57.066394 28950 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:50392
I20260807 15:08:57.066967 28950 raft_consensus.cc:482] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:57.067320 28950 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:57.072567 28950 raft_consensus.cc:504] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:57.074316 28950 leader_election.cc:288] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 3 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:57.075194 29021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:57.075827 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2bf7fa7f4b473b816ae503fe9f64a7" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:57.076591 29103 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:57.075922 29021 raft_consensus.cc:3032] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:57.077049 29021 raft_consensus.cc:729] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:57.077872 29021 consensus_queue.cc:260] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:57.079025 29021 raft_consensus.cc:3037] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:57.082723 29103 raft_consensus.cc:2454] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 3.
I20260807 15:08:57.083952 28914 leader_election.cc:302] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:57.084277 29021 raft_consensus.cc:2454] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 3.
I20260807 15:08:57.084932 29281 raft_consensus.cc:2781] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:57.085520 29281 raft_consensus.cc:686] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:57.086364 29281 consensus_queue.cc:237] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:57.094122 28841 catalog_manager.cc:5495] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 2 to 3, leader changed from 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194) to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 3 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:57.167227 29276 raft_consensus.cc:979] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4: : Instructing follower a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:57.167739 29282 raft_consensus.cc:1067] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Signalling peer a26048c84be94fb488a146f9d1205b63 to start an election
I20260807 15:08:57.169301 28950 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
from {username='slave'} at 127.0.0.1:50392
I20260807 15:08:57.169802 28950 raft_consensus.cc:482] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:57.170120 28950 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:57.174599 28950 raft_consensus.cc:504] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:57.176081 28950 leader_election.cc:288] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 3 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:08:57.177069 29021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:57.177223 29103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "a26048c84be94fb488a146f9d1205b63" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:08:57.177572 29021 raft_consensus.cc:3032] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:08:57.177758 29103 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:57.177896 29021 raft_consensus.cc:729] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:08:57.178685 29021 consensus_queue.cc:260] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:57.179610 29021 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:08:57.183264 29103 raft_consensus.cc:2454] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 3.
I20260807 15:08:57.184253 29021 raft_consensus.cc:2454] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26048c84be94fb488a146f9d1205b63 in term 3.
I20260807 15:08:57.184265 28914 leader_election.cc:302] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a26048c84be94fb488a146f9d1205b63, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:57.185189 29281 raft_consensus.cc:2781] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:08:57.185688 29281 raft_consensus.cc:686] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Becoming Leader. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:57.186522 29281 consensus_queue.cc:237] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:57.195642 28841 catalog_manager.cc:5495] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 reported cstate change: term changed from 2 to 3, leader changed from 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194) to a26048c84be94fb488a146f9d1205b63 (127.27.144.193). New cstate: current_term: 3 leader_uuid: "a26048c84be94fb488a146f9d1205b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:08:57.305430 29103 raft_consensus.cc:1261] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:57.306710 29281 consensus_queue.cc:1035] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:57.319351 29021 raft_consensus.cc:1261] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:57.321569 29296 consensus_queue.cc:1035] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:08:57.440459 29103 raft_consensus.cc:1261] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:57.441856 29296 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:08:57.456295 29021 raft_consensus.cc:1261] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:57.457923 29301 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:08:57.479043 29021 raft_consensus.cc:1261] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:57.480564 29301 consensus_queue.cc:1035] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:08:57.481884 29103 raft_consensus.cc:1261] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:57.483470 29301 consensus_queue.cc:1035] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:08:57.484103 29103 raft_consensus.cc:1261] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:57.485781 29281 consensus_queue.cc:1035] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:57.505391 29025 raft_consensus.cc:1261] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:08:57.512601 29301 consensus_queue.cc:1035] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260807 15:08:57.621127 29102 raft_consensus.cc:1261] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:57.622690 29296 consensus_queue.cc:1035] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:08:57.636922 29025 raft_consensus.cc:1261] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Refusing update from remote peer a26048c84be94fb488a146f9d1205b63: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:08:57.639971 29296 consensus_queue.cc:1035] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:08:59.837896 28227 auto_leader_rebalancer-test.cc:373] The leader distribution is
I20260807 15:08:59.838994 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:08:59.849303 28950 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:50422
I20260807 15:08:59.850142 28950 raft_consensus.cc:595] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Received request to transfer leadership to TS 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:59.852883 28950 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:50422
I20260807 15:08:59.853293 28950 raft_consensus.cc:595] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Received request to transfer leadership to TS 2e170a81ade34927b5e90c5fb90700e4
I20260807 15:08:59.855122 28950 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5bcd7122cb164973aa89412d58bdba12"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:50422
I20260807 15:08:59.855479 28950 raft_consensus.cc:595] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Received request to transfer leadership to TS b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:59.857497 28950 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e"
dest_uuid: "a26048c84be94fb488a146f9d1205b63"
mode: GRACEFUL
new_leader_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:50422
I20260807 15:08:59.858003 28950 raft_consensus.cc:595] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 4 LEADER]: Received request to transfer leadership to TS b8eec748acf34c16a0ef093057a3870a
I20260807 15:08:59.859056 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 15:08:59.859505 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:08:59.892958 29314 raft_consensus.cc:979] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63: : Instructing follower b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:08:59.893594 29312 raft_consensus.cc:1067] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Signalling peer b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:08:59.895085 29102 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5bcd7122cb164973aa89412d58bdba12"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:39636
I20260807 15:08:59.895557 29102 raft_consensus.cc:482] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:08:59.895962 29102 raft_consensus.cc:3037] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:59.901562 29102 raft_consensus.cc:504] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:59.903700 29102 leader_election.cc:288] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 2 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117)
I20260807 15:08:59.904726 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bcd7122cb164973aa89412d58bdba12" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:08:59.905110 29025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bcd7122cb164973aa89412d58bdba12" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:08:59.905519 28950 raft_consensus.cc:3032] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:08:59.905663 29025 raft_consensus.cc:3037] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:59.905850 28950 raft_consensus.cc:729] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:08:59.906675 28950 consensus_queue.cc:260] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:59.908067 28950 raft_consensus.cc:3037] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:08:59.912770 29025 raft_consensus.cc:2454] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 2.
I20260807 15:08:59.914065 29067 leader_election.cc:302] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:08:59.914917 29280 raft_consensus.cc:2781] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:08:59.914999 28950 raft_consensus.cc:2454] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 2.
I20260807 15:08:59.915956 29280 raft_consensus.cc:686] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 2 LEADER]: Becoming Leader. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:08:59.916936 29280 consensus_queue.cc:237] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:08:59.924309 28839 catalog_manager.cc:5495] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a reported cstate change: term changed from 1 to 2, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to b8eec748acf34c16a0ef093057a3870a (127.27.144.195). New cstate: current_term: 2 leader_uuid: "b8eec748acf34c16a0ef093057a3870a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:00.028158 29314 raft_consensus.cc:979] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63: : Instructing follower 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:09:00.028637 29312 raft_consensus.cc:1067] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Signalling peer 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:09:00.030182 29025 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:47092
I20260807 15:09:00.030609 29025 raft_consensus.cc:482] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:00.030881 29025 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:00.035382 29025 raft_consensus.cc:504] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:09:00.037256 29025 leader_election.cc:288] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 3 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:09:00.038033 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:09:00.038228 29102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a3126cc355c49c4b89a108444f200d1" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:09:00.038653 28950 raft_consensus.cc:3032] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:00.038722 29102 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:00.038957 28950 raft_consensus.cc:729] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:09:00.039702 28950 consensus_queue.cc:260] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:09:00.040716 28950 raft_consensus.cc:3037] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:00.043407 29102 raft_consensus.cc:2454] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 3.
I20260807 15:09:00.044593 28992 leader_election.cc:302] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:09:00.045351 29313 raft_consensus.cc:2781] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:00.045542 28950 raft_consensus.cc:2454] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 3.
I20260807 15:09:00.046689 29313 raft_consensus.cc:686] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:09:00.047595 29313 consensus_queue.cc:237] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:09:00.054389 28839 catalog_manager.cc:5495] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 2 to 3, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 3 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:00.290261 29314 raft_consensus.cc:979] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63: : Instructing follower b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:09:00.290755 29312 raft_consensus.cc:1067] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 4 LEADER]: Signalling peer b8eec748acf34c16a0ef093057a3870a to start an election
I20260807 15:09:00.292382 29106 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e"
dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
from {username='slave'} at 127.0.0.1:39636
I20260807 15:09:00.292893 29106 raft_consensus.cc:482] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:00.293217 29106 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:09:00.299145 29106 raft_consensus.cc:504] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:09:00.300873 29106 leader_election.cc:288] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 5 election: Requested vote from peers 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117), a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091)
I20260807 15:09:00.301929 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:09:00.302000 29025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc7f0474b1a4b7e9cd9914f563ab25e" candidate_uuid: "b8eec748acf34c16a0ef093057a3870a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
I20260807 15:09:00.302506 28950 raft_consensus.cc:3032] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:09:00.302565 29025 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:09:00.302861 28950 raft_consensus.cc:729] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:09:00.303634 28950 consensus_queue.cc:260] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:09:00.304836 28950 raft_consensus.cc:3037] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:09:00.308320 29314 raft_consensus.cc:979] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63: : Instructing follower 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:09:00.308892 29312 raft_consensus.cc:1067] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Signalling peer 2e170a81ade34927b5e90c5fb90700e4 to start an election
I20260807 15:09:00.309538 29025 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 5.
I20260807 15:09:00.310734 29021 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017"
dest_uuid: "2e170a81ade34927b5e90c5fb90700e4"
from {username='slave'} at 127.0.0.1:47092
I20260807 15:09:00.310891 29067 leader_election.cc:302] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:09:00.311241 29021 raft_consensus.cc:482] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:00.311177 28950 raft_consensus.cc:2454] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eec748acf34c16a0ef093057a3870a in term 5.
I20260807 15:09:00.311704 29021 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:00.311784 29280 raft_consensus.cc:2781] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:09:00.312392 29280 raft_consensus.cc:686] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 5 LEADER]: Becoming Leader. State: Replica: b8eec748acf34c16a0ef093057a3870a, State: Running, Role: LEADER
I20260807 15:09:00.313300 29280 consensus_queue.cc:237] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } }
I20260807 15:09:00.316632 29021 raft_consensus.cc:504] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:09:00.318562 29021 leader_election.cc:288] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 4 election: Requested vote from peers a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091), b8eec748acf34c16a0ef093057a3870a (127.27.144.195:46027)
I20260807 15:09:00.319787 29106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8eec748acf34c16a0ef093057a3870a"
I20260807 15:09:00.320336 29106 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:00.320971 28839 catalog_manager.cc:5495] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a reported cstate change: term changed from 4 to 5, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to b8eec748acf34c16a0ef093057a3870a (127.27.144.195). New cstate: current_term: 5 leader_uuid: "b8eec748acf34c16a0ef093057a3870a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:00.323282 28950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3238b5df16f34781bf3b4e58010d1017" candidate_uuid: "2e170a81ade34927b5e90c5fb90700e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a26048c84be94fb488a146f9d1205b63"
I20260807 15:09:00.323947 28950 raft_consensus.cc:3032] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:09:00.324249 28950 raft_consensus.cc:729] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a26048c84be94fb488a146f9d1205b63, State: Running, Role: LEADER
I20260807 15:09:00.324985 28950 consensus_queue.cc:260] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:09:00.326143 28950 raft_consensus.cc:3037] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:00.326256 29106 raft_consensus.cc:2454] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 4.
I20260807 15:09:00.327286 28992 leader_election.cc:302] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e170a81ade34927b5e90c5fb90700e4, b8eec748acf34c16a0ef093057a3870a; no voters:
I20260807 15:09:00.328197 29313 raft_consensus.cc:2781] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:09:00.328691 29313 raft_consensus.cc:686] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 LEADER]: Becoming Leader. State: Replica: 2e170a81ade34927b5e90c5fb90700e4, State: Running, Role: LEADER
I20260807 15:09:00.329659 29313 consensus_queue.cc:237] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } }
I20260807 15:09:00.333555 28950 raft_consensus.cc:2454] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e170a81ade34927b5e90c5fb90700e4 in term 4.
I20260807 15:09:00.337888 28839 catalog_manager.cc:5495] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 reported cstate change: term changed from 3 to 4, leader changed from a26048c84be94fb488a146f9d1205b63 (127.27.144.193) to 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194). New cstate: current_term: 4 leader_uuid: "2e170a81ade34927b5e90c5fb90700e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:00.466171 29021 raft_consensus.cc:1261] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:00.467461 29280 consensus_queue.cc:1035] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:00.481141 28950 raft_consensus.cc:1261] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:00.484777 29315 consensus_queue.cc:1035] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:00.495589 29106 raft_consensus.cc:1261] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:00.496878 29313 consensus_queue.cc:1035] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:00.505676 28950 raft_consensus.cc:1261] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:00.507931 29321 consensus_queue.cc:1035] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:00.783447 29106 raft_consensus.cc:1261] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:09:00.784849 29321 consensus_queue.cc:1035] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eec748acf34c16a0ef093057a3870a" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:00.796015 28950 raft_consensus.cc:1261] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Refusing update from remote peer 2e170a81ade34927b5e90c5fb90700e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:09:00.797410 29321 consensus_queue.cc:1035] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:00.799777 28950 raft_consensus.cc:1261] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 5 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 15:09:00.801128 29280 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26048c84be94fb488a146f9d1205b63" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:09:00.810258 29021 raft_consensus.cc:1261] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 5 FOLLOWER]: Refusing update from remote peer b8eec748acf34c16a0ef093057a3870a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 15:09:00.812394 29280 consensus_queue.cc:1035] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e170a81ade34927b5e90c5fb90700e4" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:00.860473 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:00.866338 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:00.866859 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:01.868054 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:01.873401 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:01.873891 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:02.874780 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:02.880357 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:02.880841 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:03.881738 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:03.887265 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:03.887792 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:04.888711 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:04.894440 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:04.894943 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:05.895792 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:05.902060 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:05.902552 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:06.903488 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:06.908823 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:06.909318 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:07.910179 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:07.915362 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:07.915846 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:08.917013 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:08.922835 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 15:09:08.923327 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:09.954053 28227 auto_leader_rebalancer-test.cc:384] The leader distribution is
I20260807 15:09:09.954682 28227 tablet_server.cc:178] TabletServer@127.27.144.193:0 shutting down...
I20260807 15:09:09.989367 28227 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 15:09:09.990176 28227 tablet_replica.cc:330] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:09.991012 28227 raft_consensus.cc:2229] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:09.991731 28227 raft_consensus.cc:2258] T bd3401a06dd34713843f26f578012f0e P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:09.993943 28227 tablet_replica.cc:330] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:09.994519 28227 raft_consensus.cc:2229] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:09:09.995409 28227 raft_consensus.cc:2258] T ebf88fa06c3f4acabe37f641d007ff54 P a26048c84be94fb488a146f9d1205b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:09.997397 28227 tablet_replica.cc:330] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:09.997959 28227 raft_consensus.cc:2229] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:09.998447 28227 raft_consensus.cc:2258] T 5bcd7122cb164973aa89412d58bdba12 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.000434 28227 tablet_replica.cc:330] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:10.000973 28227 raft_consensus.cc:2229] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.001852 28227 raft_consensus.cc:2258] T a55e7cb8d220466985728925e97bab75 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.004369 28227 tablet_replica.cc:330] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:10.005237 28227 raft_consensus.cc:2229] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260807 15:09:10.005640 29067 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260807 15:09:10.005826 28227 raft_consensus.cc:2258] T 3a3126cc355c49c4b89a108444f200d1 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.008374 28227 tablet_replica.cc:330] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:10.009151 28227 raft_consensus.cc:2229] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 3 LEADER]: Raft consensus shutting down.
W20260807 15:09:10.009608 29067 consensus_peers.cc:487] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a -> Peer a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091): Couldn't send request to peer a26048c84be94fb488a146f9d1205b63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:10.010296 28227 raft_consensus.cc:2258] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P a26048c84be94fb488a146f9d1205b63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.012398 28227 tablet_replica.cc:330] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:10.012925 28227 raft_consensus.cc:2229] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.013439 28227 raft_consensus.cc:2258] T d542463930bb44b095447ed9e2f2b745 P a26048c84be94fb488a146f9d1205b63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.015184 28227 tablet_replica.cc:330] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:10.015641 28227 raft_consensus.cc:2229] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.016139 28227 raft_consensus.cc:2258] T 3238b5df16f34781bf3b4e58010d1017 P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.017942 28227 tablet_replica.cc:330] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:10.018373 28227 raft_consensus.cc:2229] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 4 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.019140 28227 raft_consensus.cc:2258] T bd9a7e182d834b58926232f982697295 P a26048c84be94fb488a146f9d1205b63 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.020869 28227 tablet_replica.cc:330] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63: stopping tablet replica
I20260807 15:09:10.021278 28227 raft_consensus.cc:2229] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.021699 28227 raft_consensus.cc:2258] T 8bc7f0474b1a4b7e9cd9914f563ab25e P a26048c84be94fb488a146f9d1205b63 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.055866 28227 tablet_server.cc:194] TabletServer@127.27.144.193:0 shutdown complete.
W20260807 15:09:10.068846 29067 consensus_peers.cc:487] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a -> Peer a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091): Couldn't send request to peer a26048c84be94fb488a146f9d1205b63. Status: Network error: Client connection negotiation failed: client connection to 127.27.144.193:35091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:10.080722 28227 tablet_server.cc:178] TabletServer@127.27.144.194:0 shutting down...
W20260807 15:09:10.113621 29067 consensus_peers.cc:487] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a -> Peer 2e170a81ade34927b5e90c5fb90700e4 (127.27.144.194:46117): Couldn't send request to peer 2e170a81ade34927b5e90c5fb90700e4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:10.117707 28227 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 15:09:10.118470 28227 tablet_replica.cc:330] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.119262 28227 raft_consensus.cc:2229] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.119807 28227 raft_consensus.cc:2258] T a55e7cb8d220466985728925e97bab75 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.121950 28227 tablet_replica.cc:330] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.122514 28227 raft_consensus.cc:2229] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.123097 28227 raft_consensus.cc:2258] T 8bc7f0474b1a4b7e9cd9914f563ab25e P 2e170a81ade34927b5e90c5fb90700e4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.125178 28227 tablet_replica.cc:330] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.125845 28227 raft_consensus.cc:2229] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.126729 28227 raft_consensus.cc:2258] T d542463930bb44b095447ed9e2f2b745 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.128657 28227 tablet_replica.cc:330] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.129185 28227 raft_consensus.cc:2229] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.129637 28227 raft_consensus.cc:2258] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.131353 28227 tablet_replica.cc:330] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.131996 28227 raft_consensus.cc:2229] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.132860 28227 raft_consensus.cc:2258] T 3238b5df16f34781bf3b4e58010d1017 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.134626 28227 tablet_replica.cc:330] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.135130 28227 raft_consensus.cc:2229] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.136006 28227 raft_consensus.cc:2258] T 3a3126cc355c49c4b89a108444f200d1 P 2e170a81ade34927b5e90c5fb90700e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.137881 28227 tablet_replica.cc:330] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.138376 28227 raft_consensus.cc:2229] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.138914 28227 raft_consensus.cc:2258] T bd9a7e182d834b58926232f982697295 P 2e170a81ade34927b5e90c5fb90700e4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.140776 28227 tablet_replica.cc:330] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.141301 28227 raft_consensus.cc:2229] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.141686 28227 raft_consensus.cc:2258] T ebf88fa06c3f4acabe37f641d007ff54 P 2e170a81ade34927b5e90c5fb90700e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.143273 28227 tablet_replica.cc:330] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.143692 28227 raft_consensus.cc:2229] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.144119 28227 raft_consensus.cc:2258] T bd3401a06dd34713843f26f578012f0e P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.145778 28227 tablet_replica.cc:330] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4: stopping tablet replica
I20260807 15:09:10.146341 28227 raft_consensus.cc:2229] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.146754 28227 raft_consensus.cc:2258] T 5bcd7122cb164973aa89412d58bdba12 P 2e170a81ade34927b5e90c5fb90700e4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260807 15:09:10.194947 29067 consensus_peers.cc:487] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a -> Peer a26048c84be94fb488a146f9d1205b63 (127.27.144.193:35091): Couldn't send request to peer a26048c84be94fb488a146f9d1205b63. Status: Network error: Client connection negotiation failed: client connection to 127.27.144.193:35091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:10.195632 28227 tablet_server.cc:194] TabletServer@127.27.144.194:0 shutdown complete.
I20260807 15:09:10.214383 28227 tablet_server.cc:178] TabletServer@127.27.144.195:0 shutting down...
I20260807 15:09:10.244419 28227 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 15:09:10.245040 28227 tablet_replica.cc:330] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.245679 28227 raft_consensus.cc:2229] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 2 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.246572 28227 raft_consensus.cc:2258] T bd3401a06dd34713843f26f578012f0e P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.248456 28227 tablet_replica.cc:330] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.248971 28227 raft_consensus.cc:2229] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 5 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.249727 28227 raft_consensus.cc:2258] T 8bc7f0474b1a4b7e9cd9914f563ab25e P b8eec748acf34c16a0ef093057a3870a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.251490 28227 tablet_replica.cc:330] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.252058 28227 raft_consensus.cc:2229] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.252498 28227 raft_consensus.cc:2258] T d542463930bb44b095447ed9e2f2b745 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.254073 28227 tablet_replica.cc:330] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.254570 28227 raft_consensus.cc:2229] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.254992 28227 raft_consensus.cc:2258] T bd9a7e182d834b58926232f982697295 P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.256743 28227 tablet_replica.cc:330] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.257202 28227 raft_consensus.cc:2229] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.257686 28227 raft_consensus.cc:2258] T 3a3126cc355c49c4b89a108444f200d1 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.259289 28227 tablet_replica.cc:330] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.259760 28227 raft_consensus.cc:2229] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.260215 28227 raft_consensus.cc:2258] T 7b2bf7fa7f4b473b816ae503fe9f64a7 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.261761 28227 tablet_replica.cc:330] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.262212 28227 raft_consensus.cc:2229] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.262643 28227 raft_consensus.cc:2258] T 3238b5df16f34781bf3b4e58010d1017 P b8eec748acf34c16a0ef093057a3870a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.264323 28227 tablet_replica.cc:330] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.264868 28227 raft_consensus.cc:2229] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.265282 28227 raft_consensus.cc:2258] T a55e7cb8d220466985728925e97bab75 P b8eec748acf34c16a0ef093057a3870a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.266873 28227 tablet_replica.cc:330] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.267306 28227 raft_consensus.cc:2229] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:10.267696 28227 raft_consensus.cc:2258] T ebf88fa06c3f4acabe37f641d007ff54 P b8eec748acf34c16a0ef093057a3870a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.269362 28227 tablet_replica.cc:330] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a: stopping tablet replica
I20260807 15:09:10.269903 28227 raft_consensus.cc:2229] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 2 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.270707 28227 raft_consensus.cc:2258] T 5bcd7122cb164973aa89412d58bdba12 P b8eec748acf34c16a0ef093057a3870a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.301306 28227 tablet_server.cc:194] TabletServer@127.27.144.195:0 shutdown complete.
I20260807 15:09:10.321956 28227 master.cc:537] Master@127.27.144.254:42227 shutting down...
I20260807 15:09:10.351305 28227 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:09:10.351979 28227 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:10.352326 28227 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0118bbb4f500429987a8bc2219a77974: stopping tablet replica
I20260807 15:09:10.372035 28227 master.cc:552] Master@127.27.144.254:42227 shutdown complete.
2e170a81ade34927b5e90c5fb90700e4 4
a26048c84be94fb488a146f9d1205b63 5
b8eec748acf34c16a0ef093057a3870a 1
2e170a81ade34927b5e90c5fb90700e4 4
a26048c84be94fb488a146f9d1205b63 3
b8eec748acf34c16a0ef093057a3870a 3
2e170a81ade34927b5e90c5fb90700e4 1
a26048c84be94fb488a146f9d1205b63 8
b8eec748acf34c16a0ef093057a3870a 1
2e170a81ade34927b5e90c5fb90700e4 3
a26048c84be94fb488a146f9d1205b63 4
b8eec748acf34c16a0ef093057a3870a 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29024 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260807 15:09:10.418555 28227 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.144.254:38573
I20260807 15:09:10.419715 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:09:10.425606 29356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:10.425863 29357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:10.427430 29359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:09:10.429172 28227 server_base.cc:1034] running on GCE node
I20260807 15:09:10.430406 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:09:10.430624 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:09:10.430799 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115350430769 us; error 0 us; skew 500 ppm
I20260807 15:09:10.431375 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:09:10.434090 28227 webserver.cc:460] Webserver started at http://127.27.144.254:46563/ using document root <none> and password file <none>
I20260807 15:09:10.434608 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:09:10.434844 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:09:10.435180 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:09:10.436546 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/master-0-root/instance:
uuid: "ce1e7c41f736452080b21dd983c40ba5"
format_stamp: "Formatted at 2026-08-07 15:09:10 on dist-test-slave-27sr"
I20260807 15:09:10.441413 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:09:10.444895 29364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.445659 28227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260807 15:09:10.445959 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/master-0-root
uuid: "ce1e7c41f736452080b21dd983c40ba5"
format_stamp: "Formatted at 2026-08-07 15:09:10 on dist-test-slave-27sr"
I20260807 15:09:10.446260 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:09:10.472653 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:09:10.473986 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:09:10.514526 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.254:38573
I20260807 15:09:10.514626 29417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.254:38573 every 8 connection(s)
I20260807 15:09:10.518684 29418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:10.528644 29418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Bootstrap starting.
I20260807 15:09:10.533000 29418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:10.537127 29418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: No bootstrap required, opened a new log
I20260807 15:09:10.539155 29418 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1e7c41f736452080b21dd983c40ba5" member_type: VOTER }
I20260807 15:09:10.539629 29418 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:10.539820 29418 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce1e7c41f736452080b21dd983c40ba5, State: Initialized, Role: FOLLOWER
I20260807 15:09:10.540462 29418 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1e7c41f736452080b21dd983c40ba5" member_type: VOTER }
I20260807 15:09:10.540879 29418 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:09:10.541072 29418 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:09:10.541280 29418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:10.545346 29418 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1e7c41f736452080b21dd983c40ba5" member_type: VOTER }
I20260807 15:09:10.545827 29418 leader_election.cc:302] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce1e7c41f736452080b21dd983c40ba5; no voters:
I20260807 15:09:10.547058 29418 leader_election.cc:288] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:09:10.547497 29421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:10.548936 29421 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [term 1 LEADER]: Becoming Leader. State: Replica: ce1e7c41f736452080b21dd983c40ba5, State: Running, Role: LEADER
I20260807 15:09:10.549650 29421 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1e7c41f736452080b21dd983c40ba5" member_type: VOTER }
I20260807 15:09:10.550269 29418 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:09:10.554401 29422 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce1e7c41f736452080b21dd983c40ba5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1e7c41f736452080b21dd983c40ba5" member_type: VOTER } }
I20260807 15:09:10.555219 29422 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [sys.catalog]: This master's current role is: LEADER
I20260807 15:09:10.556038 29423 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce1e7c41f736452080b21dd983c40ba5. Latest consensus state: current_term: 1 leader_uuid: "ce1e7c41f736452080b21dd983c40ba5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce1e7c41f736452080b21dd983c40ba5" member_type: VOTER } }
I20260807 15:09:10.556847 29423 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5 [sys.catalog]: This master's current role is: LEADER
I20260807 15:09:10.557049 29429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:09:10.562496 29429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:09:10.567493 28227 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 15:09:10.572216 29429 catalog_manager.cc:1347] Generated new cluster ID: 59056cd55a874cb2aaf4f9e77ba27d45
I20260807 15:09:10.572528 29429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:09:10.604632 29429 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:09:10.606421 29429 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:09:10.622948 29429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Generated new TSK 0
I20260807 15:09:10.623677 29429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:09:10.634104 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:09:10.640647 29440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:10.641625 29441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:10.643162 29443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:09:10.644302 28227 server_base.cc:1034] running on GCE node
I20260807 15:09:10.645293 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:09:10.645520 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:09:10.645684 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115350645663 us; error 0 us; skew 500 ppm
I20260807 15:09:10.646194 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:09:10.648706 28227 webserver.cc:460] Webserver started at http://127.27.144.193:35087/ using document root <none> and password file <none>
I20260807 15:09:10.649189 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:09:10.649398 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:09:10.649665 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:09:10.650802 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/instance:
uuid: "9bbe5c211ab64989a57350f34f007ced"
format_stamp: "Formatted at 2026-08-07 15:09:10 on dist-test-slave-27sr"
I20260807 15:09:10.655416 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 15:09:10.658818 29448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.659636 28227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:09:10.659992 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root
uuid: "9bbe5c211ab64989a57350f34f007ced"
format_stamp: "Formatted at 2026-08-07 15:09:10 on dist-test-slave-27sr"
I20260807 15:09:10.660274 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:09:10.669163 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:09:10.670418 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:09:10.671773 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:09:10.674011 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:09:10.674213 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.674461 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:09:10.674638 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.715966 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.193:39125
I20260807 15:09:10.716094 29514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.193:39125 every 8 connection(s)
I20260807 15:09:10.720690 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:09:10.728847 29520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:10.730971 29521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:10.732312 29523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:09:10.734596 28227 server_base.cc:1034] running on GCE node
I20260807 15:09:10.736917 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:09:10.737202 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:09:10.737279 29515 heartbeater.cc:347] Connected to a master server at 127.27.144.254:38573
I20260807 15:09:10.737393 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115350737378 us; error 0 us; skew 500 ppm
I20260807 15:09:10.737826 29515 heartbeater.cc:464] Registering TS with master...
I20260807 15:09:10.738082 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:09:10.738718 29515 heartbeater.cc:511] Master 127.27.144.254:38573 requested a full tablet report, sending...
I20260807 15:09:10.740991 28227 webserver.cc:460] Webserver started at http://127.27.144.194:36585/ using document root <none> and password file <none>
I20260807 15:09:10.741307 29382 ts_manager.cc:194] Registered new tserver with Master: 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:10.741680 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:09:10.741945 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:09:10.742257 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:09:10.743848 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/instance:
uuid: "00dd11bf8fd9487580aba733c2996a4a"
format_stamp: "Formatted at 2026-08-07 15:09:10 on dist-test-slave-27sr"
I20260807 15:09:10.744097 29382 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48676
I20260807 15:09:10.749084 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 15:09:10.752691 29528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.753504 28227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:09:10.753814 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root
uuid: "00dd11bf8fd9487580aba733c2996a4a"
format_stamp: "Formatted at 2026-08-07 15:09:10 on dist-test-slave-27sr"
I20260807 15:09:10.754112 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:09:10.767580 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:09:10.768905 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:09:10.770411 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:09:10.772765 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:09:10.772946 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.773237 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:09:10.773398 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.816004 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.194:33589
I20260807 15:09:10.816093 29594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.194:33589 every 8 connection(s)
I20260807 15:09:10.820943 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:09:10.828630 29598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:10.829602 29599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:09:10.832986 28227 server_base.cc:1034] running on GCE node
W20260807 15:09:10.833544 29601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:09:10.834631 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:09:10.834874 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:09:10.835058 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115350835045 us; error 0 us; skew 500 ppm
I20260807 15:09:10.835402 29595 heartbeater.cc:347] Connected to a master server at 127.27.144.254:38573
I20260807 15:09:10.835618 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:09:10.835775 29595 heartbeater.cc:464] Registering TS with master...
I20260807 15:09:10.836690 29595 heartbeater.cc:511] Master 127.27.144.254:38573 requested a full tablet report, sending...
I20260807 15:09:10.838451 28227 webserver.cc:460] Webserver started at http://127.27.144.195:34281/ using document root <none> and password file <none>
I20260807 15:09:10.838997 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:09:10.838922 29382 ts_manager.cc:194] Registered new tserver with Master: 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:10.839301 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:09:10.839658 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:09:10.840772 29382 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48690
I20260807 15:09:10.840883 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/instance:
uuid: "4b092f7f951b4137b5d7810056684270"
format_stamp: "Formatted at 2026-08-07 15:09:10 on dist-test-slave-27sr"
I20260807 15:09:10.845750 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:09:10.849236 29606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.849982 28227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 15:09:10.850279 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root
uuid: "4b092f7f951b4137b5d7810056684270"
format_stamp: "Formatted at 2026-08-07 15:09:10 on dist-test-slave-27sr"
I20260807 15:09:10.850598 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:09:10.867000 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:09:10.868402 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:09:10.869885 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:09:10.872450 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:09:10.872702 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.872989 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:09:10.873162 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:10.917218 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.195:33653
I20260807 15:09:10.917351 29674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.195:33653 every 8 connection(s)
I20260807 15:09:10.932848 29676 heartbeater.cc:347] Connected to a master server at 127.27.144.254:38573
I20260807 15:09:10.933368 29676 heartbeater.cc:464] Registering TS with master...
I20260807 15:09:10.934389 29676 heartbeater.cc:511] Master 127.27.144.254:38573 requested a full tablet report, sending...
I20260807 15:09:10.937036 29382 ts_manager.cc:194] Registered new tserver with Master: 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:10.937744 28227 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017275983s
I20260807 15:09:10.939319 29382 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48700
I20260807 15:09:10.940605 28227 test_util.cc:268] Using random seed: 1661291424
I20260807 15:09:10.967466 29382 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48702:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:09:10.974046 29382 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:09:11.197489 29636 tablet_service.cc:1467] Processing CreateTablet for tablet 18498fa007b248e9af1c1eaeee728541 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 15:09:11.199087 29636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18498fa007b248e9af1c1eaeee728541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.199926 29635 tablet_service.cc:1467] Processing CreateTablet for tablet 242c77eb4afe4fe39d26981ed5003ef2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 15:09:11.201514 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 242c77eb4afe4fe39d26981ed5003ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.205170 29633 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd4477c59ed4f0181a2d23b25c4a030 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 15:09:11.206698 29633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd4477c59ed4f0181a2d23b25c4a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.209139 29632 tablet_service.cc:1467] Processing CreateTablet for tablet 9b21bbc939b9464c8729e18e5401dd65 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 15:09:11.209930 29478 tablet_service.cc:1467] Processing CreateTablet for tablet 18498fa007b248e9af1c1eaeee728541 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 15:09:11.210629 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b21bbc939b9464c8729e18e5401dd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.211345 29478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18498fa007b248e9af1c1eaeee728541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.212333 29631 tablet_service.cc:1467] Processing CreateTablet for tablet 00c48154e8c94a9c83e606db06e22092 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 15:09:11.213771 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c48154e8c94a9c83e606db06e22092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.216009 29477 tablet_service.cc:1467] Processing CreateTablet for tablet 242c77eb4afe4fe39d26981ed5003ef2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 15:09:11.217403 29477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 242c77eb4afe4fe39d26981ed5003ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.217123 29475 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd4477c59ed4f0181a2d23b25c4a030 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 15:09:11.218511 29475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd4477c59ed4f0181a2d23b25c4a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.219354 29476 tablet_service.cc:1467] Processing CreateTablet for tablet f07d982710354dfca721e4641d589839 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 15:09:11.220750 29476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f07d982710354dfca721e4641d589839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.220607 29471 tablet_service.cc:1467] Processing CreateTablet for tablet 0f0c51854d34430796b3dedd4548f4d5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 15:09:11.221921 29471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f0c51854d34430796b3dedd4548f4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.222605 29472 tablet_service.cc:1467] Processing CreateTablet for tablet 00c48154e8c94a9c83e606db06e22092 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 15:09:11.225363 29473 tablet_service.cc:1467] Processing CreateTablet for tablet 9b21bbc939b9464c8729e18e5401dd65 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 15:09:11.230020 29634 tablet_service.cc:1467] Processing CreateTablet for tablet f07d982710354dfca721e4641d589839 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 15:09:11.231582 29634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f07d982710354dfca721e4641d589839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.232337 29472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c48154e8c94a9c83e606db06e22092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.232859 29559 tablet_service.cc:1467] Processing CreateTablet for tablet 18498fa007b248e9af1c1eaeee728541 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 15:09:11.234297 29559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18498fa007b248e9af1c1eaeee728541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.236402 29473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b21bbc939b9464c8729e18e5401dd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.237933 29558 tablet_service.cc:1467] Processing CreateTablet for tablet 242c77eb4afe4fe39d26981ed5003ef2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 15:09:11.238857 29630 tablet_service.cc:1467] Processing CreateTablet for tablet 0f0c51854d34430796b3dedd4548f4d5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 15:09:11.240703 29630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f0c51854d34430796b3dedd4548f4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.239432 29558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 242c77eb4afe4fe39d26981ed5003ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.241460 29556 tablet_service.cc:1467] Processing CreateTablet for tablet 9fd4477c59ed4f0181a2d23b25c4a030 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 15:09:11.243172 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd4477c59ed4f0181a2d23b25c4a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.245476 29555 tablet_service.cc:1467] Processing CreateTablet for tablet 9b21bbc939b9464c8729e18e5401dd65 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 15:09:11.247181 29555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b21bbc939b9464c8729e18e5401dd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.249439 29554 tablet_service.cc:1467] Processing CreateTablet for tablet 00c48154e8c94a9c83e606db06e22092 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 15:09:11.251259 29554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c48154e8c94a9c83e606db06e22092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.253021 29553 tablet_service.cc:1467] Processing CreateTablet for tablet 0f0c51854d34430796b3dedd4548f4d5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 15:09:11.269546 29553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f0c51854d34430796b3dedd4548f4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.254633 29629 tablet_service.cc:1467] Processing CreateTablet for tablet c3d1cf6540694063929e5d2508204bd1 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 15:09:11.273490 29629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3d1cf6540694063929e5d2508204bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.256522 29628 tablet_service.cc:1467] Processing CreateTablet for tablet acc305388a594a0f8be8d24006e0b323 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 15:09:11.277456 29628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc305388a594a0f8be8d24006e0b323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.257704 29470 tablet_service.cc:1467] Processing CreateTablet for tablet c3d1cf6540694063929e5d2508204bd1 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 15:09:11.281420 29470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3d1cf6540694063929e5d2508204bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.258927 29469 tablet_service.cc:1467] Processing CreateTablet for tablet acc305388a594a0f8be8d24006e0b323 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 15:09:11.261145 29552 tablet_service.cc:1467] Processing CreateTablet for tablet c3d1cf6540694063929e5d2508204bd1 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 15:09:11.286116 29469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc305388a594a0f8be8d24006e0b323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.286584 29552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3d1cf6540694063929e5d2508204bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.263597 29468 tablet_service.cc:1467] Processing CreateTablet for tablet afaa655e923f4aecbeee1b026c46810e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 15:09:11.289331 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afaa655e923f4aecbeee1b026c46810e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.263382 29557 tablet_service.cc:1467] Processing CreateTablet for tablet f07d982710354dfca721e4641d589839 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 15:09:11.293351 29557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f07d982710354dfca721e4641d589839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.293651 29551 tablet_service.cc:1467] Processing CreateTablet for tablet acc305388a594a0f8be8d24006e0b323 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 15:09:11.295042 29551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc305388a594a0f8be8d24006e0b323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.297852 29550 tablet_service.cc:1467] Processing CreateTablet for tablet afaa655e923f4aecbeee1b026c46810e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 15:09:11.299314 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afaa655e923f4aecbeee1b026c46810e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.345196 29627 tablet_service.cc:1467] Processing CreateTablet for tablet b67938f915c84df3a2da7adba02b898b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 15:09:11.346690 29627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b67938f915c84df3a2da7adba02b898b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.366258 29636 tablet_service.cc:1467] Processing CreateTablet for tablet 530a2932f7854f95a0380cbbf05f57bf (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 15:09:11.367667 29636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 530a2932f7854f95a0380cbbf05f57bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.378733 29635 tablet_service.cc:1467] Processing CreateTablet for tablet e9b0eecfdf5242a3b82bc6217faa4b96 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 15:09:11.396132 29552 tablet_service.cc:1467] Processing CreateTablet for tablet fb8a4d13c18e42ff82894fddfb0c0f0f (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 15:09:11.401672 29633 tablet_service.cc:1467] Processing CreateTablet for tablet 7645f7cacdb34a1486686ba6f848e1bb (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 15:09:11.404464 29632 tablet_service.cc:1467] Processing CreateTablet for tablet afaa655e923f4aecbeee1b026c46810e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 15:09:11.396978 29475 tablet_service.cc:1467] Processing CreateTablet for tablet 7645f7cacdb34a1486686ba6f848e1bb (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 15:09:11.408886 29475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7645f7cacdb34a1486686ba6f848e1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.409116 29551 tablet_service.cc:1467] Processing CreateTablet for tablet 7645f7cacdb34a1486686ba6f848e1bb (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 15:09:11.410622 29630 tablet_service.cc:1467] Processing CreateTablet for tablet 29795442e1dd46f3becb9daf1bd74aef (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 15:09:11.411268 29557 tablet_service.cc:1467] Processing CreateTablet for tablet b67938f915c84df3a2da7adba02b898b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 15:09:11.412745 29692 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:11.413592 29471 tablet_service.cc:1467] Processing CreateTablet for tablet b67938f915c84df3a2da7adba02b898b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 15:09:11.414870 29471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b67938f915c84df3a2da7adba02b898b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.416776 29691 tablet_bootstrap.cc:492] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:11.428596 29554 tablet_service.cc:1467] Processing CreateTablet for tablet 530a2932f7854f95a0380cbbf05f57bf (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 15:09:11.424368 29552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8a4d13c18e42ff82894fddfb0c0f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.431650 29631 tablet_service.cc:1467] Processing CreateTablet for tablet e6a9409698ac457faa20f77f1cf661a7 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 15:09:11.432107 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9b0eecfdf5242a3b82bc6217faa4b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.436312 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6a9409698ac457faa20f77f1cf661a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.439777 29693 tablet_bootstrap.cc:492] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:11.455235 29554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 530a2932f7854f95a0380cbbf05f57bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.458931 29551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7645f7cacdb34a1486686ba6f848e1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.459280 29550 tablet_service.cc:1467] Processing CreateTablet for tablet e9b0eecfdf5242a3b82bc6217faa4b96 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 15:09:11.461694 29633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7645f7cacdb34a1486686ba6f848e1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.461699 29557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b67938f915c84df3a2da7adba02b898b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.467409 29630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29795442e1dd46f3becb9daf1bd74aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.423579 29472 tablet_service.cc:1467] Processing CreateTablet for tablet 530a2932f7854f95a0380cbbf05f57bf (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 15:09:11.472311 29472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 530a2932f7854f95a0380cbbf05f57bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.480237 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afaa655e923f4aecbeee1b026c46810e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 15:09:11.487761 29366 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 45256us
I20260807 15:09:11.493709 29555 tablet_service.cc:1467] Processing CreateTablet for tablet 72d26b2e21c544129f8af911afa3aa3a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 15:09:11.496178 29468 tablet_service.cc:1467] Processing CreateTablet for tablet e6a9409698ac457faa20f77f1cf661a7 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 15:09:11.498024 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6a9409698ac457faa20f77f1cf661a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.500839 29692 tablet_bootstrap.cc:654] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:11.475581 29636 tablet_service.cc:1467] Processing CreateTablet for tablet 72d26b2e21c544129f8af911afa3aa3a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 15:09:11.506543 29636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d26b2e21c544129f8af911afa3aa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.506783 29556 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd4d41c286445e997322bdb49e97c65 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 15:09:11.509733 29559 tablet_service.cc:1467] Processing CreateTablet for tablet b45f04f91dc84b71b311beec0d34d756 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
W20260807 15:09:11.512035 29365 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 44806.5us
I20260807 15:09:11.479543 29558 tablet_service.cc:1467] Processing CreateTablet for tablet e6a9409698ac457faa20f77f1cf661a7 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 15:09:11.512930 29628 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd4d41c286445e997322bdb49e97c65 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 15:09:11.514170 29628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd4d41c286445e997322bdb49e97c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.471154 29478 tablet_service.cc:1467] Processing CreateTablet for tablet e9b0eecfdf5242a3b82bc6217faa4b96 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 15:09:11.517444 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9b0eecfdf5242a3b82bc6217faa4b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.520221 29558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6a9409698ac457faa20f77f1cf661a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.520438 29478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9b0eecfdf5242a3b82bc6217faa4b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.523132 29555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d26b2e21c544129f8af911afa3aa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.527228 29469 tablet_service.cc:1467] Processing CreateTablet for tablet 72d26b2e21c544129f8af911afa3aa3a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 15:09:11.533072 29691 tablet_bootstrap.cc:654] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:11.537675 29634 tablet_service.cc:1467] Processing CreateTablet for tablet b45f04f91dc84b71b311beec0d34d756 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 15:09:11.539211 29559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45f04f91dc84b71b311beec0d34d756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.546128 29692 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:11.564484 29692 ts_tablet_manager.cc:1397] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.152s user 0.012s sys 0.004s
I20260807 15:09:11.564998 29476 tablet_service.cc:1467] Processing CreateTablet for tablet 8f248aa577ff4c798c99df5834ea66e5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260807 15:09:11.566193 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:11.554239 29553 tablet_service.cc:1467] Processing CreateTablet for tablet 8f248aa577ff4c798c99df5834ea66e5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 15:09:11.567451 29692 raft_consensus.cc:348] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.572335 29692 raft_consensus.cc:374] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:11.557852 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd4d41c286445e997322bdb49e97c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.539170 29627 tablet_service.cc:1467] Processing CreateTablet for tablet 8f248aa577ff4c798c99df5834ea66e5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 15:09:11.552806 29634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45f04f91dc84b71b311beec0d34d756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.576221 29473 tablet_service.cc:1467] Processing CreateTablet for tablet 5fd4d41c286445e997322bdb49e97c65 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 15:09:11.577456 29475 tablet_service.cc:1467] Processing CreateTablet for tablet b45f04f91dc84b71b311beec0d34d756 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 15:09:11.567615 29469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72d26b2e21c544129f8af911afa3aa3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.579631 29627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f248aa577ff4c798c99df5834ea66e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.570209 29693 tablet_bootstrap.cc:654] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:11.584827 29557 tablet_service.cc:1467] Processing CreateTablet for tablet b1d288f694924e79826a10fc7cff8351 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 15:09:11.586251 29557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d288f694924e79826a10fc7cff8351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.587615 29691 tablet_bootstrap.cc:492] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:11.588133 29691 ts_tablet_manager.cc:1397] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.172s user 0.015s sys 0.000s
I20260807 15:09:11.589210 29629 tablet_service.cc:1467] Processing CreateTablet for tablet b1d288f694924e79826a10fc7cff8351 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 15:09:11.590729 29629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d288f694924e79826a10fc7cff8351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.592238 29475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45f04f91dc84b71b311beec0d34d756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.591272 29553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f248aa577ff4c798c99df5834ea66e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.593758 29691 raft_consensus.cc:348] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:11.594568 29691 raft_consensus.cc:374] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:11.594873 29691 raft_consensus.cc:729] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:11.572649 29692 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:11.595644 29691 consensus_queue.cc:260] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:11.596545 29692 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.593777 29471 tablet_service.cc:1467] Processing CreateTablet for tablet fb8a4d13c18e42ff82894fddfb0c0f0f (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 15:09:11.603300 29473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd4d41c286445e997322bdb49e97c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.604904 29477 tablet_service.cc:1467] Processing CreateTablet for tablet 29795442e1dd46f3becb9daf1bd74aef (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 15:09:11.606336 29477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29795442e1dd46f3becb9daf1bd74aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.608258 29471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8a4d13c18e42ff82894fddfb0c0f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.589090 29470 tablet_service.cc:1467] Processing CreateTablet for tablet b1d288f694924e79826a10fc7cff8351 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 15:09:11.612365 29476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f248aa577ff4c798c99df5834ea66e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.613085 29470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d288f694924e79826a10fc7cff8351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.625707 29555 tablet_service.cc:1467] Processing CreateTablet for tablet c10b42b2212f45838c83e394b00482df (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 15:09:11.627239 29555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c10b42b2212f45838c83e394b00482df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.662804 29692 ts_tablet_manager.cc:1428] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.098s user 0.010s sys 0.010s
I20260807 15:09:11.663684 29595 heartbeater.cc:503] Master 127.27.144.254:38573 was elected leader, sending a full tablet report...
I20260807 15:09:11.664145 29692 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:11.666806 29693 tablet_bootstrap.cc:492] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:11.667294 29693 ts_tablet_manager.cc:1397] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.228s user 0.019s sys 0.000s
I20260807 15:09:11.670065 29693 raft_consensus.cc:348] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.670825 29693 raft_consensus.cc:374] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:11.671123 29693 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:11.676852 29552 tablet_service.cc:1467] Processing CreateTablet for tablet fa52dbe02da546099c32896b927af8e2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 15:09:11.678170 29552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa52dbe02da546099c32896b927af8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.680233 29692 tablet_bootstrap.cc:654] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:11.682893 29554 tablet_service.cc:1467] Processing CreateTablet for tablet 3518672558d94e27a30f3efea0bbeab6 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 15:09:11.684144 29554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3518672558d94e27a30f3efea0bbeab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.684101 29472 tablet_service.cc:1467] Processing CreateTablet for tablet 3518672558d94e27a30f3efea0bbeab6 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 15:09:11.685701 29472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3518672558d94e27a30f3efea0bbeab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.688898 29559 tablet_service.cc:1467] Processing CreateTablet for tablet fdb4dc5833b24c4092e293f2ad6736bd (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 15:09:11.690155 29559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdb4dc5833b24c4092e293f2ad6736bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.695917 29693 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.705087 29468 tablet_service.cc:1467] Processing CreateTablet for tablet c10b42b2212f45838c83e394b00482df (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 15:09:11.710500 29550 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3630618bf44ca9b6ede886159dab7a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 15:09:11.720674 29676 heartbeater.cc:503] Master 127.27.144.254:38573 was elected leader, sending a full tablet report...
I20260807 15:09:11.720561 29699 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:11.731976 29635 tablet_service.cc:1467] Processing CreateTablet for tablet fb8a4d13c18e42ff82894fddfb0c0f0f (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 15:09:11.648602 29558 tablet_service.cc:1467] Processing CreateTablet for tablet 29795442e1dd46f3becb9daf1bd74aef (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 15:09:11.695742 29551 tablet_service.cc:1467] Processing CreateTablet for tablet 41559fba51e74c12a634f00bc225cd7b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 15:09:11.729635 29699 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:11.752477 29515 heartbeater.cc:503] Master 127.27.144.254:38573 was elected leader, sending a full tablet report...
I20260807 15:09:11.757130 29632 tablet_service.cc:1467] Processing CreateTablet for tablet 3518672558d94e27a30f3efea0bbeab6 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 15:09:11.759416 29691 ts_tablet_manager.cc:1428] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.170s user 0.019s sys 0.014s
I20260807 15:09:11.763686 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8a4d13c18e42ff82894fddfb0c0f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.769160 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3518672558d94e27a30f3efea0bbeab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.770112 29633 tablet_service.cc:1467] Processing CreateTablet for tablet fa52dbe02da546099c32896b927af8e2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 15:09:11.771404 29633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa52dbe02da546099c32896b927af8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.772496 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c10b42b2212f45838c83e394b00482df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.772797 29691 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:11.772993 29630 tablet_service.cc:1467] Processing CreateTablet for tablet fdb4dc5833b24c4092e293f2ad6736bd (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 15:09:11.755826 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3630618bf44ca9b6ede886159dab7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.774312 29630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdb4dc5833b24c4092e293f2ad6736bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.777419 29636 tablet_service.cc:1467] Processing CreateTablet for tablet 41559fba51e74c12a634f00bc225cd7b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 15:09:11.778785 29636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41559fba51e74c12a634f00bc225cd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.780206 29558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29795442e1dd46f3becb9daf1bd74aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.779040 29628 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3630618bf44ca9b6ede886159dab7a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 15:09:11.781118 29628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3630618bf44ca9b6ede886159dab7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.781836 29478 tablet_service.cc:1467] Processing CreateTablet for tablet fdb4dc5833b24c4092e293f2ad6736bd (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 15:09:11.784373 29631 tablet_service.cc:1467] Processing CreateTablet for tablet c10b42b2212f45838c83e394b00482df (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 15:09:11.785549 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c10b42b2212f45838c83e394b00482df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.763640 29693 ts_tablet_manager.cc:1428] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.096s user 0.016s sys 0.023s
I20260807 15:09:11.792945 29693 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:11.797065 29635 tablet_service.cc:1467] Processing CreateTablet for tablet d87368aeb34548079f36255279bee400 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 15:09:11.798385 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d87368aeb34548079f36255279bee400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.801542 29692 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:11.802060 29692 ts_tablet_manager.cc:1397] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.138s user 0.027s sys 0.015s
I20260807 15:09:11.808928 29471 tablet_service.cc:1467] Processing CreateTablet for tablet 41559fba51e74c12a634f00bc225cd7b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 15:09:11.821146 29551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41559fba51e74c12a634f00bc225cd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.826007 29475 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3630618bf44ca9b6ede886159dab7a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 15:09:11.829982 29469 tablet_service.cc:1467] Processing CreateTablet for tablet d87368aeb34548079f36255279bee400 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 15:09:11.721119 29477 tablet_service.cc:1467] Processing CreateTablet for tablet fa52dbe02da546099c32896b927af8e2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 15:09:11.833391 29627 tablet_service.cc:1467] Processing CreateTablet for tablet 62050f8fd36a4c19bd25be548475deb7 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 15:09:11.835245 29627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62050f8fd36a4c19bd25be548475deb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.836006 29699 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:11.839766 29692 raft_consensus.cc:348] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.840804 29478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdb4dc5833b24c4092e293f2ad6736bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.840706 29692 raft_consensus.cc:374] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:11.841223 29692 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:11.842002 29692 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.842073 29556 tablet_service.cc:1467] Processing CreateTablet for tablet d87368aeb34548079f36255279bee400 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 15:09:11.845465 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d87368aeb34548079f36255279bee400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.863237 29691 tablet_bootstrap.cc:654] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:11.850832 29634 tablet_service.cc:1467] Processing CreateTablet for tablet 030a7060e7f744ff9a4e02ea0cd710bd (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 15:09:11.865118 29634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 030a7060e7f744ff9a4e02ea0cd710bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.867630 29559 tablet_service.cc:1467] Processing CreateTablet for tablet 62050f8fd36a4c19bd25be548475deb7 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 15:09:11.870688 29472 tablet_service.cc:1467] Processing CreateTablet for tablet 030a7060e7f744ff9a4e02ea0cd710bd (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 15:09:11.877455 29692 ts_tablet_manager.cc:1428] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.075s user 0.010s sys 0.003s
I20260807 15:09:11.883271 29550 tablet_service.cc:1467] Processing CreateTablet for tablet 030a7060e7f744ff9a4e02ea0cd710bd (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 15:09:11.887941 29471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41559fba51e74c12a634f00bc225cd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.900430 29701 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:11.901043 29701 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.907747 29628 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1d390489b54758a0ce36af133f1d57 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 15:09:11.932762 29698 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:11.939420 29698 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.947283 29469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d87368aeb34548079f36255279bee400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:11.957757 29470 tablet_service.cc:1467] Processing CreateTablet for tablet 62050f8fd36a4c19bd25be548475deb7 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 15:09:11.961247 29629 tablet_service.cc:1467] Processing CreateTablet for tablet 990a0811150c4c53ae50cc69c71f2926 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 15:09:11.962965 29473 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1d390489b54758a0ce36af133f1d57 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 15:09:11.988665 29698 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:11.989280 29698 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:11.989842 29698 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:11.991815 29698 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:12.002193 29558 tablet_service.cc:1467] Processing CreateTablet for tablet 990a0811150c4c53ae50cc69c71f2926 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 15:09:12.005282 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:12.002902 29692 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:12.002157 29627 tablet_service.cc:1467] Processing CreateTablet for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 15:09:12.003607 29631 tablet_service.cc:1467] Processing CreateTablet for tablet f4c7484fae4742a2a93ad8d15ee4241c (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 15:09:12.005867 29553 tablet_service.cc:1467] Processing CreateTablet for tablet f4c7484fae4742a2a93ad8d15ee4241c (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 15:09:12.009402 29628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1d390489b54758a0ce36af133f1d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.004437 29551 tablet_service.cc:1467] Processing CreateTablet for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 15:09:12.011281 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4c7484fae4742a2a93ad8d15ee4241c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 15:09:12.009877 29609 leader_election.cc:341] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.012367 29636 tablet_service.cc:1467] Processing CreateTablet for tablet 574818cf180d48a68d8b72da65c22af5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 15:09:12.013705 29636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574818cf180d48a68d8b72da65c22af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.016245 29559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62050f8fd36a4c19bd25be548475deb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.017751 29476 tablet_service.cc:1467] Processing CreateTablet for tablet 990a0811150c4c53ae50cc69c71f2926 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 15:09:12.021857 29468 tablet_service.cc:1467] Processing CreateTablet for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 15:09:12.020234 29627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.025347 29692 tablet_bootstrap.cc:654] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.030836 29475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3630618bf44ca9b6ede886159dab7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.031558 29473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1d390489b54758a0ce36af133f1d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.002157 29555 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1d390489b54758a0ce36af133f1d57 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 15:09:12.039878 29558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 990a0811150c4c53ae50cc69c71f2926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.040804 29632 tablet_service.cc:1467] Processing CreateTablet for tablet 2dfe227bf905440483bae2c8a294fb1b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 15:09:12.049729 29476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 990a0811150c4c53ae50cc69c71f2926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.050416 29557 tablet_service.cc:1467] Processing CreateTablet for tablet 574818cf180d48a68d8b72da65c22af5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 15:09:12.043437 29701 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:12.066509 29554 tablet_service.cc:1467] Processing CreateTablet for tablet 2dfe227bf905440483bae2c8a294fb1b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 15:09:12.068075 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.069336 29691 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:12.069893 29691 ts_tablet_manager.cc:1397] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.307s user 0.012s sys 0.018s
I20260807 15:09:12.074008 29629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 990a0811150c4c53ae50cc69c71f2926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.077126 29691 raft_consensus.cc:348] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.078223 29691 raft_consensus.cc:374] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.078562 29691 raft_consensus.cc:729] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.117293 29468 tablet_service.cc:1467] Processing CreateTablet for tablet 574818cf180d48a68d8b72da65c22af5 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 15:09:12.087603 29555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1d390489b54758a0ce36af133f1d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.079362 29691 consensus_queue.cc:260] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.126261 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dfe227bf905440483bae2c8a294fb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.125576 29470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62050f8fd36a4c19bd25be548475deb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.152741 29554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dfe227bf905440483bae2c8a294fb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.172372 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 030a7060e7f744ff9a4e02ea0cd710bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.176946 29551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.184293 29557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574818cf180d48a68d8b72da65c22af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.189007 29691 ts_tablet_manager.cc:1428] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.119s user 0.005s sys 0.005s
I20260807 15:09:12.190069 29691 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:12.191308 29693 tablet_bootstrap.cc:654] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.192323 29553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4c7484fae4742a2a93ad8d15ee4241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.173686 29635 tablet_service.cc:1467] Processing CreateTablet for tablet b1d695ebbb554e07b7258dc4e0368ce8 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 15:09:12.225792 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d695ebbb554e07b7258dc4e0368ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.202296 29628 tablet_service.cc:1467] Processing CreateTablet for tablet f23cf6497a87482cb9bd824261ba383f (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 15:09:12.233137 29628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23cf6497a87482cb9bd824261ba383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.238262 29631 tablet_service.cc:1467] Processing CreateTablet for tablet 4db6cf72c3b74ea19f67f0d479e0b364 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 15:09:12.239840 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db6cf72c3b74ea19f67f0d479e0b364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.158211 29633 tablet_service.cc:1467] Processing CreateTablet for tablet e1b28d0b706f4cacbfda48dd13e4d700 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 15:09:12.248183 29633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1b28d0b706f4cacbfda48dd13e4d700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.208520 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:12.210959 29634 tablet_service.cc:1467] Processing CreateTablet for tablet 27275fe691bf4c42814ccca06801b625 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 15:09:12.251093 29634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27275fe691bf4c42814ccca06801b625. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 15:09:12.251457 29608 leader_election.cc:341] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.252113 29608 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:12.195338 29556 tablet_service.cc:1467] Processing CreateTablet for tablet e1b28d0b706f4cacbfda48dd13e4d700 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 15:09:12.257117 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1b28d0b706f4cacbfda48dd13e4d700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.219533 29692 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:12.218925 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574818cf180d48a68d8b72da65c22af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.271512 29630 tablet_service.cc:1467] Processing CreateTablet for tablet 995314457256466c935b10a561d7003e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 15:09:12.272838 29472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 030a7060e7f744ff9a4e02ea0cd710bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.280153 29699 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:12.272913 29630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 995314457256466c935b10a561d7003e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.288998 29477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa52dbe02da546099c32896b927af8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.280990 29692 ts_tablet_manager.cc:1397] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.278s user 0.017s sys 0.029s
I20260807 15:09:12.292171 29691 tablet_bootstrap.cc:654] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.297811 29478 tablet_service.cc:1467] Processing CreateTablet for tablet 2dfe227bf905440483bae2c8a294fb1b (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 15:09:12.224275 29552 tablet_service.cc:1467] Processing CreateTablet for tablet b1d695ebbb554e07b7258dc4e0368ce8 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 15:09:12.320668 29552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d695ebbb554e07b7258dc4e0368ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.321563 29473 tablet_service.cc:1467] Processing CreateTablet for tablet e1b28d0b706f4cacbfda48dd13e4d700 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 15:09:12.323210 29475 tablet_service.cc:1467] Processing CreateTablet for tablet b1d695ebbb554e07b7258dc4e0368ce8 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 15:09:12.324200 29478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dfe227bf905440483bae2c8a294fb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.308084 29476 tablet_service.cc:1467] Processing CreateTablet for tablet f4c7484fae4742a2a93ad8d15ee4241c (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 15:09:12.324803 29473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1b28d0b706f4cacbfda48dd13e4d700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.325342 29476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4c7484fae4742a2a93ad8d15ee4241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.328598 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:12.330067 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:12.313621 29558 tablet_service.cc:1467] Processing CreateTablet for tablet 4db6cf72c3b74ea19f67f0d479e0b364 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 15:09:12.319120 29629 tablet_service.cc:1467] Processing CreateTablet for tablet b3465aa175594b588334678fe9eee6cb (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260807 15:09:12.334824 29531 leader_election.cc:341] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.335309 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:12.335564 29531 leader_election.cc:341] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:12.336994 29449 leader_election.cc:341] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.343216 29559 tablet_service.cc:1467] Processing CreateTablet for tablet 27275fe691bf4c42814ccca06801b625 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 15:09:12.344695 29559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27275fe691bf4c42814ccca06801b625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.348657 29558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db6cf72c3b74ea19f67f0d479e0b364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.348672 29475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d695ebbb554e07b7258dc4e0368ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.319120 29550 tablet_service.cc:1467] Processing CreateTablet for tablet f23cf6497a87482cb9bd824261ba383f (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 15:09:12.354136 29692 raft_consensus.cc:348] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.355019 29692 raft_consensus.cc:374] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.355372 29692 raft_consensus.cc:729] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.356299 29692 consensus_queue.cc:260] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.360165 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:12.360877 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:12.362239 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:12.355083 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23cf6497a87482cb9bd824261ba383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.364607 29629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3465aa175594b588334678fe9eee6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.366497 29634 tablet_service.cc:1467] Processing CreateTablet for tablet ca67c90d21974f08892e272b90a83ac0 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 15:09:12.367883 29634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca67c90d21974f08892e272b90a83ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.374393 29627 tablet_service.cc:1467] Processing CreateTablet for tablet 6a11f5d18a564611b87fe4b67e592ed8 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 15:09:12.386600 29636 tablet_service.cc:1467] Processing CreateTablet for tablet c235e827abcd4d26adef777f50f15d3e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 15:09:12.386879 29630 tablet_service.cc:1467] Processing CreateTablet for tablet 1fc8adcf9402487ca81d7c0edc5dd599 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260807 15:09:12.388576 29450 leader_election.cc:341] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.389171 29450 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:12.389598 29692 ts_tablet_manager.cc:1428] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.099s user 0.006s sys 0.001s
W20260807 15:09:12.388659 29533 leader_election.cc:341] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.390007 29701 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:12.390427 29533 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:12.391315 29706 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 15:09:12.391605 29533 leader_election.cc:341] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.392071 29533 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:12.393136 29706 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:12.400068 29628 tablet_service.cc:1467] Processing CreateTablet for tablet 9172782dc9b949dca48f386dd0afe164 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 15:09:12.409533 29554 tablet_service.cc:1467] Processing CreateTablet for tablet 995314457256466c935b10a561d7003e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 15:09:12.410982 29554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 995314457256466c935b10a561d7003e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.417279 29478 tablet_service.cc:1467] Processing CreateTablet for tablet 4db6cf72c3b74ea19f67f0d479e0b364 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 15:09:12.418653 29478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db6cf72c3b74ea19f67f0d479e0b364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.420071 29692 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:12.421931 29691 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:12.422478 29691 ts_tablet_manager.cc:1397] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.233s user 0.008s sys 0.004s
I20260807 15:09:12.375842 29627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a11f5d18a564611b87fe4b67e592ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.429003 29468 tablet_service.cc:1467] Processing CreateTablet for tablet f23cf6497a87482cb9bd824261ba383f (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 15:09:12.430368 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23cf6497a87482cb9bd824261ba383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.430073 29557 tablet_service.cc:1467] Processing CreateTablet for tablet b3465aa175594b588334678fe9eee6cb (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 15:09:12.431401 29557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3465aa175594b588334678fe9eee6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.436245 29699 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:12.436750 29699 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.438858 29699 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:12.438776 29551 tablet_service.cc:1467] Processing CreateTablet for tablet ca67c90d21974f08892e272b90a83ac0 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 15:09:12.440196 29551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca67c90d21974f08892e272b90a83ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.440578 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:12.441977 29472 tablet_service.cc:1467] Processing CreateTablet for tablet 27275fe691bf4c42814ccca06801b625 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 15:09:12.444175 29472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27275fe691bf4c42814ccca06801b625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.445467 29550 tablet_service.cc:1467] Processing CreateTablet for tablet 6a11f5d18a564611b87fe4b67e592ed8 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 15:09:12.450709 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a11f5d18a564611b87fe4b67e592ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.453809 29556 tablet_service.cc:1467] Processing CreateTablet for tablet c235e827abcd4d26adef777f50f15d3e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 15:09:12.455160 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c235e827abcd4d26adef777f50f15d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.445461 29633 tablet_service.cc:1467] Processing CreateTablet for tablet 37e098505a6248f0aa9d91084fbbe64e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 15:09:12.459393 29633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e098505a6248f0aa9d91084fbbe64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.461210 29555 tablet_service.cc:1467] Processing CreateTablet for tablet 1fc8adcf9402487ca81d7c0edc5dd599 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 15:09:12.462545 29555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fc8adcf9402487ca81d7c0edc5dd599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.448498 29477 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33668 (request call id 23) took 1105 ms. Trace:
I20260807 15:09:12.469209 29553 tablet_service.cc:1467] Processing CreateTablet for tablet 9172782dc9b949dca48f386dd0afe164 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 15:09:12.469656 29477 rpcz_store.cc:276] 0807 15:09:11.343248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:11.719871 (+376623us) service_pool.cc:227] Handling call
0807 15:09:11.832166 (+112295us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 15:09:11.832270 (+ 104us) ts_tablet_manager.cc:676] Creating new metadata...
0807 15:09:12.379396 (+547126us) tablet_metadata.cc:641] Metadata flushed
0807 15:09:12.447951 (+ 68555us) tablet_replica.cc:205] Creating consensus instance
0807 15:09:12.448435 (+ 484us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:09:12.470611 29553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9172782dc9b949dca48f386dd0afe164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.474080 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:12.475196 29608 leader_election.cc:341] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.475636 29559 tablet_service.cc:1467] Processing CreateTablet for tablet 37e098505a6248f0aa9d91084fbbe64e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 15:09:12.477110 29559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e098505a6248f0aa9d91084fbbe64e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 15:09:12.480542 29609 leader_election.cc:341] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.481026 29609 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:12.485502 29477 tablet_service.cc:1467] Processing CreateTablet for tablet b3465aa175594b588334678fe9eee6cb (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 15:09:12.486790 29477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3465aa175594b588334678fe9eee6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.488014 29471 tablet_service.cc:1467] Processing CreateTablet for tablet 995314457256466c935b10a561d7003e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 15:09:12.489289 29471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 995314457256466c935b10a561d7003e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.489979 29550 tablet_service.cc:1467] Processing CreateTablet for tablet 1177fe2445db43e2b8366f33a841a041 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 15:09:12.491394 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1177fe2445db43e2b8366f33a841a041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.492223 29699 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:12.495177 29692 tablet_bootstrap.cc:654] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.495803 29557 tablet_service.cc:1467] Processing CreateTablet for tablet 0a0ef49386d543e6bf09732d79976e83 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 15:09:12.497124 29557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a0ef49386d543e6bf09732d79976e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.496917 29635 tablet_service.cc:1467] Processing CreateTablet for tablet 6deeb6ab1b13402e953266974f24e09d (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 15:09:12.498193 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6deeb6ab1b13402e953266974f24e09d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.499294 29691 raft_consensus.cc:348] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.500053 29691 raft_consensus.cc:374] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.500350 29691 raft_consensus.cc:729] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.501037 29691 consensus_queue.cc:260] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.512267 29630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fc8adcf9402487ca81d7c0edc5dd599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.513010 29628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9172782dc9b949dca48f386dd0afe164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.514959 29636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c235e827abcd4d26adef777f50f15d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.526886 29693 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:12.527482 29469 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33668 (request call id 28) took 1011 ms. Trace:
I20260807 15:09:12.528278 29472 tablet_service.cc:1467] Processing CreateTablet for tablet ca67c90d21974f08892e272b90a83ac0 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 15:09:12.529665 29472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca67c90d21974f08892e272b90a83ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.530375 29558 tablet_service.cc:1467] Processing CreateTablet for tablet 4fbc64c4dbd34587a70422db1adc925c (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 15:09:12.531628 29558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fbc64c4dbd34587a70422db1adc925c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.537387 29632 tablet_service.cc:1467] Processing CreateTablet for tablet 1177fe2445db43e2b8366f33a841a041 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 15:09:12.539510 29551 tablet_service.cc:1467] Processing CreateTablet for tablet e0c073edf1454d1589526a840754b5da (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 15:09:12.542160 29691 ts_tablet_manager.cc:1428] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.119s user 0.007s sys 0.002s
I20260807 15:09:12.527871 29469 rpcz_store.cc:276] 0807 15:09:11.515702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:11.829041 (+313339us) service_pool.cc:227] Handling call
0807 15:09:11.830880 (+ 1839us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 15:09:11.831000 (+ 120us) ts_tablet_manager.cc:676] Creating new metadata...
0807 15:09:12.328682 (+497682us) tablet_metadata.cc:641] Metadata flushed
0807 15:09:12.526990 (+198308us) tablet_replica.cc:205] Creating consensus instance
0807 15:09:12.527419 (+ 429us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:09:12.545946 29691 tablet_bootstrap.cc:492] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:12.546449 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1177fe2445db43e2b8366f33a841a041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.487828 29552 tablet_service.cc:1467] Processing CreateTablet for tablet 6deeb6ab1b13402e953266974f24e09d (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 15:09:12.527407 29693 ts_tablet_manager.cc:1397] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.735s user 0.030s sys 0.015s
I20260807 15:09:12.553727 29550 tablet_service.cc:1467] Processing CreateTablet for tablet b6072ace00c943b19f41dba76504e780 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 15:09:12.549466 29706 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:12.556145 29706 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.557008 29629 tablet_service.cc:1467] Processing CreateTablet for tablet 4fbc64c4dbd34587a70422db1adc925c (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 15:09:12.545748 29469 tablet_service.cc:1467] Processing CreateTablet for tablet 6a11f5d18a564611b87fe4b67e592ed8 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 15:09:12.559413 29706 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:12.560184 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:12.560910 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:12.561594 29551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c073edf1454d1589526a840754b5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.562747 29470 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33668 (request call id 29) took 1025 ms. Trace:
I20260807 15:09:12.564777 29699 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:12.555845 29693 raft_consensus.cc:348] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:12.572654 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260807 15:09:12.574054 29596 tablet.cc:2369] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:09:12.575217 29634 tablet_service.cc:1467] Processing CreateTablet for tablet 0a0ef49386d543e6bf09732d79976e83 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 15:09:12.559616 29476 tablet_service.cc:1467] Processing CreateTablet for tablet c235e827abcd4d26adef777f50f15d3e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 15:09:12.577430 29629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fbc64c4dbd34587a70422db1adc925c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.625321 29634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a0ef49386d543e6bf09732d79976e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.624969 29559 tablet_service.cc:1467] Processing CreateTablet for tablet 81993fd783554e64b26c4f0c2344bf53 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 15:09:12.589303 29473 tablet_service.cc:1467] Processing CreateTablet for tablet 9172782dc9b949dca48f386dd0afe164 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 15:09:12.593385 29475 tablet_service.cc:1467] Processing CreateTablet for tablet 37e098505a6248f0aa9d91084fbbe64e (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 15:09:12.593499 29553 tablet_service.cc:1467] Processing CreateTablet for tablet 748d0394657643cfbf71e2bac60ff2f2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 15:09:12.613730 29631 tablet_service.cc:1467] Processing CreateTablet for tablet b6072ace00c943b19f41dba76504e780 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 15:09:12.616073 29699 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:12.618376 29533 leader_election.cc:341] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.636003 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6072ace00c943b19f41dba76504e780. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 15:09:12.636096 29531 leader_election.cc:341] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.620230 29550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6072ace00c943b19f41dba76504e780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.638372 29552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6deeb6ab1b13402e953266974f24e09d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.639335 29531 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:12.623978 29693 raft_consensus.cc:374] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.640046 29693 raft_consensus.cc:729] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.640974 29693 consensus_queue.cc:260] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.643770 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:12.644170 29693 ts_tablet_manager.cc:1428] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.091s user 0.002s sys 0.005s
I20260807 15:09:12.645097 29706 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 15:09:12.645323 29608 leader_election.cc:341] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.645924 29699 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:12.612093 29470 rpcz_store.cc:276] 0807 15:09:11.537147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:11.872617 (+335470us) service_pool.cc:227] Handling call
0807 15:09:12.019445 (+146828us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 15:09:12.019683 (+ 238us) ts_tablet_manager.cc:676] Creating new metadata...
0807 15:09:12.298114 (+278431us) tablet_metadata.cc:641] Metadata flushed
0807 15:09:12.562225 (+264111us) tablet_replica.cc:205] Creating consensus instance
0807 15:09:12.562673 (+ 448us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:09:12.647086 29553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 748d0394657643cfbf71e2bac60ff2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.622215 29627 tablet_service.cc:1467] Processing CreateTablet for tablet e0c073edf1454d1589526a840754b5da (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 15:09:12.578737 29468 tablet_service.cc:1467] Processing CreateTablet for tablet 1fc8adcf9402487ca81d7c0edc5dd599 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 15:09:12.629887 29692 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:12.668946 29469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a11f5d18a564611b87fe4b67e592ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.656301 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:12.652799 29367 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 61370.5us
W20260807 15:09:12.710343 29609 leader_election.cc:341] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.648200 29470 tablet_service.cc:1467] Processing CreateTablet for tablet 6deeb6ab1b13402e953266974f24e09d (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 15:09:12.736194 29609 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:12.737171 29699 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:12.710884 29693 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:12.710919 29476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c235e827abcd4d26adef777f50f15d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.707331 29692 ts_tablet_manager.cc:1397] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.292s user 0.010s sys 0.014s
I20260807 15:09:12.739051 29475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e098505a6248f0aa9d91084fbbe64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.739821 29470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6deeb6ab1b13402e953266974f24e09d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.742012 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fc8adcf9402487ca81d7c0edc5dd599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.744205 29473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9172782dc9b949dca48f386dd0afe164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.713485 29478 tablet_service.cc:1467] Processing CreateTablet for tablet 1177fe2445db43e2b8366f33a841a041 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 15:09:12.747769 29633 tablet_service.cc:1467] Processing CreateTablet for tablet 748d0394657643cfbf71e2bac60ff2f2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 15:09:12.749210 29693 tablet_bootstrap.cc:654] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.750612 29478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1177fe2445db43e2b8366f33a841a041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.758092 29470 tablet_service.cc:1467] Processing CreateTablet for tablet b6072ace00c943b19f41dba76504e780 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 15:09:12.760169 29627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c073edf1454d1589526a840754b5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.759938 29554 tablet_service.cc:1467] Processing CreateTablet for tablet 2fe1df4603dd4ecdad74103a84926118 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 15:09:12.720366 29628 tablet_service.cc:1467] Processing CreateTablet for tablet 81993fd783554e64b26c4f0c2344bf53 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 15:09:12.715749 29477 tablet_service.cc:1467] Processing CreateTablet for tablet 0a0ef49386d543e6bf09732d79976e83 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 15:09:12.724390 29701 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:12.729120 29471 tablet_service.cc:1467] Processing CreateTablet for tablet 4fbc64c4dbd34587a70422db1adc925c (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 15:09:12.761487 29628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81993fd783554e64b26c4f0c2344bf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.731225 29691 tablet_bootstrap.cc:654] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.760368 29470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6072ace00c943b19f41dba76504e780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.761543 29701 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.763291 29471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fbc64c4dbd34587a70422db1adc925c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.720953 29632 tablet_service.cc:1467] Processing CreateTablet for tablet 2fe1df4603dd4ecdad74103a84926118 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 15:09:12.764650 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fe1df4603dd4ecdad74103a84926118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.765199 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:12.766709 29450 leader_election.cc:341] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.767549 29701 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:12.769181 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:12.770016 29647 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:12.771422 29449 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:12.771872 29475 tablet_service.cc:1467] Processing CreateTablet for tablet e0c073edf1454d1589526a840754b5da (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 15:09:12.773268 29475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c073edf1454d1589526a840754b5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.776129 29701 raft_consensus.cc:2781] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:12.776677 29554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fe1df4603dd4ecdad74103a84926118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.776646 29701 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:12.777241 29701 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:12.778980 29633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 748d0394657643cfbf71e2bac60ff2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.779592 29477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a0ef49386d543e6bf09732d79976e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.783422 29559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81993fd783554e64b26c4f0c2344bf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.783458 29692 raft_consensus.cc:348] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.790870 29692 raft_consensus.cc:374] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.791285 29692 raft_consensus.cc:729] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.792415 29692 consensus_queue.cc:260] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.795094 29692 ts_tablet_manager.cc:1428] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.056s user 0.002s sys 0.003s
I20260807 15:09:12.824420 29473 tablet_service.cc:1467] Processing CreateTablet for tablet 748d0394657643cfbf71e2bac60ff2f2 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 15:09:12.825807 29473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 748d0394657643cfbf71e2bac60ff2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.842082 29692 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:12.844106 29468 tablet_service.cc:1467] Processing CreateTablet for tablet 81993fd783554e64b26c4f0c2344bf53 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 15:09:12.845920 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81993fd783554e64b26c4f0c2344bf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.803757 29701 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.866200 29693 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:12.866752 29693 ts_tablet_manager.cc:1397] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.156s user 0.010s sys 0.001s
I20260807 15:09:12.869518 29693 raft_consensus.cc:348] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.870278 29693 raft_consensus.cc:374] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.870569 29693 raft_consensus.cc:729] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.871351 29693 consensus_queue.cc:260] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.881120 29701 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:12.882290 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:12.882938 29647 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:12.884327 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:09:12.885807 29450 leader_election.cc:341] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:12.886230 29691 tablet_bootstrap.cc:492] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:12.886725 29691 ts_tablet_manager.cc:1397] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.341s user 0.029s sys 0.067s
I20260807 15:09:12.889592 29691 raft_consensus.cc:348] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.890413 29691 raft_consensus.cc:374] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.890679 29647 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:12.892014 29449 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:12.890714 29691 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.894151 29691 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.894624 29472 tablet_service.cc:1467] Processing CreateTablet for tablet 2fe1df4603dd4ecdad74103a84926118 (DEFAULT_TABLE table=test-workload [id=31d0d00623fd4306950184679e10f7d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 15:09:12.896898 29691 ts_tablet_manager.cc:1428] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.010s user 0.006s sys 0.002s
I20260807 15:09:12.897914 29691 tablet_bootstrap.cc:492] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:12.898948 29701 raft_consensus.cc:2781] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:12.899502 29701 raft_consensus.cc:686] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:12.900450 29701 consensus_queue.cc:237] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.904284 29691 tablet_bootstrap.cc:654] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.904731 29692 tablet_bootstrap.cc:654] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.909124 29472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fe1df4603dd4ecdad74103a84926118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:12.915518 29693 ts_tablet_manager.cc:1428] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.048s user 0.010s sys 0.005s
I20260807 15:09:12.916706 29693 tablet_bootstrap.cc:492] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:12.925602 29693 tablet_bootstrap.cc:654] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.930891 29691 tablet_bootstrap.cc:492] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:12.931521 29691 ts_tablet_manager.cc:1397] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.034s user 0.020s sys 0.009s
I20260807 15:09:12.935590 29691 raft_consensus.cc:348] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.936726 29691 raft_consensus.cc:374] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.937150 29691 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.938371 29691 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.942451 29691 ts_tablet_manager.cc:1428] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.010s user 0.008s sys 0.002s
I20260807 15:09:12.943879 29691 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:12.953810 29691 tablet_bootstrap.cc:654] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.954341 29379 catalog_manager.cc:5495] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:12.962432 29692 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:12.963071 29692 ts_tablet_manager.cc:1397] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.121s user 0.013s sys 0.000s
I20260807 15:09:12.966790 29692 raft_consensus.cc:348] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.968067 29692 raft_consensus.cc:374] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.969388 29693 tablet_bootstrap.cc:492] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:12.976509 29693 ts_tablet_manager.cc:1397] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.060s user 0.012s sys 0.006s
I20260807 15:09:12.972687 29691 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:12.979496 29693 raft_consensus.cc:348] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:12.980324 29693 raft_consensus.cc:374] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.980469 29691 ts_tablet_manager.cc:1397] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.037s user 0.017s sys 0.011s
I20260807 15:09:12.980722 29693 raft_consensus.cc:729] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.981580 29701 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:12.981779 29693 consensus_queue.cc:260] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:12.982079 29701 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.984329 29693 ts_tablet_manager.cc:1428] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260807 15:09:12.984580 29691 raft_consensus.cc:348] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.985266 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:12.985652 29701 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:12.985713 29691 raft_consensus.cc:374] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:12.985953 29570 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:12.985288 29693 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:12.986763 29692 raft_consensus.cc:729] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.986907 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:12.988116 29450 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:12.987854 29692 consensus_queue.cc:260] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.989187 29701 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:12.989589 29701 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:12.989967 29701 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:12.990648 29692 ts_tablet_manager.cc:1428] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.027s user 0.004s sys 0.002s
I20260807 15:09:12.993335 29693 tablet_bootstrap.cc:654] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:12.994495 29692 tablet_bootstrap.cc:492] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:12.986181 29691 raft_consensus.cc:729] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:12.996961 29691 consensus_queue.cc:260] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:12.998008 29647 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:12.999382 29691 ts_tablet_manager.cc:1428] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260807 15:09:13.000401 29701 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.001822 29692 tablet_bootstrap.cc:654] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.003607 29691 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:13.018764 29691 tablet_bootstrap.cc:654] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.019165 29692 tablet_bootstrap.cc:492] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:13.019743 29692 ts_tablet_manager.cc:1397] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.025s user 0.014s sys 0.004s
I20260807 15:09:13.023236 29692 raft_consensus.cc:348] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.024717 29692 raft_consensus.cc:374] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.025215 29692 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.026513 29692 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.029841 29692 ts_tablet_manager.cc:1428] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260807 15:09:13.031036 29692 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:13.031800 29691 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:13.032349 29691 ts_tablet_manager.cc:1397] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.014s
I20260807 15:09:13.033038 29701 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.034067 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:13.034340 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:13.034680 29570 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.034992 29647 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.035122 29691 raft_consensus.cc:348] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.036211 29691 raft_consensus.cc:374] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.036496 29691 raft_consensus.cc:729] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.037205 29691 consensus_queue.cc:260] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.039726 29691 ts_tablet_manager.cc:1428] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260807 15:09:13.039794 29692 tablet_bootstrap.cc:654] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.040786 29691 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:13.045398 29647 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:13.051095 29449 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:13.049292 29693 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:13.051338 29570 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:13.052310 29701 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:13.052783 29693 ts_tablet_manager.cc:1397] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.068s user 0.014s sys 0.019s
I20260807 15:09:13.052989 29701 raft_consensus.cc:686] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:13.054275 29701 consensus_queue.cc:237] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.047456 29691 tablet_bootstrap.cc:654] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.055599 29693 raft_consensus.cc:348] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.056392 29693 raft_consensus.cc:374] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.056704 29693 raft_consensus.cc:729] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.057480 29693 consensus_queue.cc:260] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.059001 29699 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.059743 29693 ts_tablet_manager.cc:1428] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260807 15:09:13.059691 29699 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.060904 29693 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:13.065685 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:13.067484 29608 leader_election.cc:341] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.067644 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:13.068339 29699 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.068432 29487 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:13.069891 29609 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:13.071270 29699 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.071679 29699 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.072086 29699 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.072764 29692 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:13.073732 29692 ts_tablet_manager.cc:1397] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.021s
I20260807 15:09:13.077606 29724 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.078071 29692 raft_consensus.cc:348] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.078194 29724 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:13.079000 29692 raft_consensus.cc:374] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.079334 29692 raft_consensus.cc:729] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.079751 29706 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.080246 29706 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.080111 29692 consensus_queue.cc:260] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.080752 29724 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.082441 29706 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.082917 29699 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.068426 29693 tablet_bootstrap.cc:654] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.085153 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:13.085937 29647 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:13.088341 29531 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:13.089200 29691 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:13.089872 29691 ts_tablet_manager.cc:1397] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.049s user 0.020s sys 0.003s
I20260807 15:09:13.089733 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:13.090528 29647 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:13.091998 29449 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:13.093364 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:13.093494 29691 raft_consensus.cc:348] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.094520 29691 raft_consensus.cc:374] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.094882 29691 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
W20260807 15:09:13.095960 29533 leader_election.cc:341] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.095741 29691 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.094882 29699 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.097826 29740 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.098284 29740 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.098464 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:13.098701 29740 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:13.100257 29608 leader_election.cc:341] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.101471 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:13.102910 29487 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.103359 29691 ts_tablet_manager.cc:1428] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260807 15:09:13.102258 29724 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.103935 29724 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.108763 29724 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.110175 29740 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.104346 29691 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:13.114916 29487 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:13.116274 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:13.116535 29609 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:13.105345 29692 ts_tablet_manager.cc:1428] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.031s user 0.022s sys 0.002s
I20260807 15:09:13.108276 29693 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:13.117609 29693 ts_tablet_manager.cc:1397] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.057s user 0.012s sys 0.004s
I20260807 15:09:13.117652 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:13.118367 29692 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:13.118502 29742 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 15:09:13.119338 29450 leader_election.cc:341] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.120339 29742 raft_consensus.cc:686] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:13.121073 29693 raft_consensus.cc:348] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.122004 29693 raft_consensus.cc:374] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.121479 29742 consensus_queue.cc:237] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:13.123838 29533 leader_election.cc:341] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.124861 29740 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.125195 29692 tablet_bootstrap.cc:654] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.126905 29691 tablet_bootstrap.cc:654] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.127748 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:13.128480 29647 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.122339 29693 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.131333 29693 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.117039 29724 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:13.136061 29724 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.140026 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:13.143333 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:13.144891 29740 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.145414 29740 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:13.145773 29450 leader_election.cc:341] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.149690 29382 catalog_manager.cc:5495] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:13.141530 29646 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.152869 29693 ts_tablet_manager.cc:1428] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.035s user 0.010s sys 0.001s
I20260807 15:09:13.153177 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:13.154790 29693 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
W20260807 15:09:13.155686 29533 leader_election.cc:341] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.157032 29647 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:13.159044 29531 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.150629 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:13.161084 29645 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:13.159991 29740 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.144686 29692 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:13.163352 29692 ts_tablet_manager.cc:1397] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.045s user 0.018s sys 0.007s
I20260807 15:09:13.167486 29692 raft_consensus.cc:348] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.168324 29692 raft_consensus.cc:374] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.168658 29692 raft_consensus.cc:729] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.169178 29531 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.169467 29692 consensus_queue.cc:260] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.170384 29740 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.161520 29706 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:13.171860 29740 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.176430 29740 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.194484 29382 catalog_manager.cc:5495] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:13.196022 29692 ts_tablet_manager.cc:1428] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.032s user 0.014s sys 0.011s
I20260807 15:09:13.198750 29693 tablet_bootstrap.cc:654] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.202056 29692 tablet_bootstrap.cc:492] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:13.213019 29692 tablet_bootstrap.cc:654] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.222848 29691 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:13.223341 29691 ts_tablet_manager.cc:1397] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.119s user 0.015s sys 0.007s
I20260807 15:09:13.227002 29691 raft_consensus.cc:348] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.227883 29691 raft_consensus.cc:374] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.229094 29691 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.230154 29691 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.232467 29691 ts_tablet_manager.cc:1428] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260807 15:09:13.233227 29691 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:13.219520 29706 raft_consensus.cc:686] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:13.236187 29646 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:13.237654 29706 consensus_queue.cc:237] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.238332 29449 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:13.241091 29744 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:13.242080 29744 raft_consensus.cc:686] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:13.243149 29744 consensus_queue.cc:237] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:13.248020 29740 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.249244 29693 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:13.249905 29693 ts_tablet_manager.cc:1397] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.015s
I20260807 15:09:13.253643 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:09:13.256170 29533 leader_election.cc:341] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.259404 29740 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.259656 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:13.260805 29646 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.257404 29693 raft_consensus.cc:348] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.262921 29693 raft_consensus.cc:374] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.263425 29693 raft_consensus.cc:729] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.267884 29692 tablet_bootstrap.cc:492] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:13.268527 29692 ts_tablet_manager.cc:1397] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.067s user 0.022s sys 0.020s
I20260807 15:09:13.259014 29691 tablet_bootstrap.cc:654] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.272321 29724 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.273458 29724 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.277469 29724 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.277921 29692 raft_consensus.cc:348] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:13.278806 29692 raft_consensus.cc:374] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.279116 29692 raft_consensus.cc:729] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.279839 29692 consensus_queue.cc:260] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:13.281250 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:13.282578 29692 ts_tablet_manager.cc:1428] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.014s user 0.005s sys 0.003s
I20260807 15:09:13.283987 29692 tablet_bootstrap.cc:492] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:13.279506 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:13.285426 29449 leader_election.cc:341] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.286826 29570 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:13.288865 29450 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:13.290572 29744 raft_consensus.cc:2781] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.291199 29744 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.291627 29692 tablet_bootstrap.cc:654] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.291736 29744 raft_consensus.cc:3037] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.292037 29646 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:13.293983 29531 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.295293 29706 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:13.296023 29706 raft_consensus.cc:686] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:13.264484 29693 consensus_queue.cc:260] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.297099 29701 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.297787 29706 consensus_queue.cc:237] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.300333 29693 ts_tablet_manager.cc:1428] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.050s user 0.010s sys 0.004s
I20260807 15:09:13.290156 29382 catalog_manager.cc:5495] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:13.301487 29693 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:13.297861 29701 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.309890 29740 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.311800 29740 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:13.315747 29742 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.316594 29742 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.316850 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:13.318337 29646 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 1: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:13.320355 29742 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.320863 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:13.321889 29488 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:13.322361 29740 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:13.324427 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:13.326013 29692 tablet_bootstrap.cc:492] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:13.329357 29692 ts_tablet_manager.cc:1397] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.046s user 0.012s sys 0.004s
I20260807 15:09:13.329303 29570 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:13.298871 29380 catalog_manager.cc:5495] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:13.326485 29609 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:13.327625 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:13.334473 29742 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.328115 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:13.335080 29742 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.338157 29693 tablet_bootstrap.cc:654] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.335954 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.338362 29742 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.338393 29692 raft_consensus.cc:348] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.340257 29692 raft_consensus.cc:374] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.340514 29692 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.341580 29740 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.341205 29692 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.343525 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:13.344674 29646 raft_consensus.cc:2379] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:09:13.344954 29692 ts_tablet_manager.cc:1428] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.015s user 0.009s sys 0.000s
I20260807 15:09:13.345830 29692 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:13.348342 29449 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:13.349928 29724 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.358834 29692 tablet_bootstrap.cc:654] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.358290 29742 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.361688 29742 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.339182 29701 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.364578 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:13.365432 29488 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.366474 29691 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:13.366927 29691 ts_tablet_manager.cc:1397] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.134s user 0.005s sys 0.024s
I20260807 15:09:13.369300 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:13.370034 29569 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.370223 29691 raft_consensus.cc:348] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.371052 29691 raft_consensus.cc:374] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.371379 29691 raft_consensus.cc:729] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.372368 29691 consensus_queue.cc:260] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.375368 29691 ts_tablet_manager.cc:1428] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.008s user 0.000s sys 0.008s
I20260807 15:09:13.378010 29748 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.382799 29748 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.384745 29691 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:13.391297 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:13.391604 29748 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.395941 29570 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.393977 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:13.401505 29646 raft_consensus.cc:2379] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 1: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:13.402949 29693 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:13.403479 29693 ts_tablet_manager.cc:1397] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.102s user 0.005s sys 0.022s
I20260807 15:09:13.388514 29724 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:13.404543 29531 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.412056 29691 tablet_bootstrap.cc:654] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.416936 29744 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.413003 29724 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.418490 29693 raft_consensus.cc:348] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.419435 29693 raft_consensus.cc:374] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.419750 29693 raft_consensus.cc:729] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.397607 29488 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:13.422204 29748 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:13.423991 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:13.431093 29568 raft_consensus.cc:3037] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.424220 29742 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.432734 29742 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.433534 29692 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:13.434413 29692 ts_tablet_manager.cc:1397] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.089s user 0.009s sys 0.009s
I20260807 15:09:13.435681 29742 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.437551 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:13.438257 29692 raft_consensus.cc:348] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.439172 29692 raft_consensus.cc:374] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.419826 29744 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.426216 29693 consensus_queue.cc:260] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.424743 29758 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260807 15:09:13.442701 29693 ts_tablet_manager.cc:1428] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.039s user 0.005s sys 0.002s
I20260807 15:09:13.439536 29692 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.425684 29609 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:13.444140 29692 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.445493 29570 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:13.424896 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:13.447347 29692 ts_tablet_manager.cc:1428] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260807 15:09:13.448479 29692 tablet_bootstrap.cc:492] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
W20260807 15:09:13.448210 29449 leader_election.cc:341] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.449043 29742 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:13.448911 29608 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:13.450551 29699 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.425222 29740 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:13.451078 29699 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.451570 29699 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.459852 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:13.424623 29569 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:13.468817 29693 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:13.481803 29568 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:13.483081 29382 catalog_manager.cc:5495] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:13.487365 29450 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:13.488550 29724 raft_consensus.cc:2781] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:13.489037 29724 raft_consensus.cc:686] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:13.493316 29699 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.493408 29724 consensus_queue.cc:237] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:13.499869 29609 leader_election.cc:341] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.511140 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:13.511956 29568 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.505066 29699 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.513509 29762 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.520469 29762 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.522221 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:13.525704 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:13.527806 29609 leader_election.cc:341] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.506402 29742 raft_consensus.cc:686] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:13.527935 29762 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:09:13.529314 29609 leader_election.cc:341] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.530195 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:13.533495 29608 leader_election.cc:341] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.534304 29608 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.536430 29762 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:13.540591 29568 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:13.530169 29742 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.548666 29691 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:13.555119 29691 ts_tablet_manager.cc:1397] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.171s user 0.025s sys 0.008s
I20260807 15:09:13.539023 29724 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.559881 29693 tablet_bootstrap.cc:654] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.562561 29608 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.563812 29762 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:13.564615 29762 raft_consensus.cc:686] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:13.560748 29724 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.565766 29382 catalog_manager.cc:5495] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:13.566078 29762 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.569638 29724 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.573602 29724 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.574420 29764 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 15:09:13.582657 29691 raft_consensus.cc:348] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.583446 29691 raft_consensus.cc:374] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.572434 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:13.584877 29646 raft_consensus.cc:2454] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:13.586609 29449 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:13.587059 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:13.587932 29570 raft_consensus.cc:2454] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:13.588012 29724 raft_consensus.cc:2781] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.588778 29724 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.589425 29724 raft_consensus.cc:3037] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.583705 29691 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.593142 29691 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.600948 29691 ts_tablet_manager.cc:1428] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.040s user 0.006s sys 0.000s
I20260807 15:09:13.602497 29691 tablet_bootstrap.cc:492] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:13.604517 29570 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.600464 29692 tablet_bootstrap.cc:654] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
W20260807 15:09:13.628239 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:13.630072 29724 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.639415 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:13.641625 29645 raft_consensus.cc:3037] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.649175 29740 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.664733 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:13.666036 29569 raft_consensus.cc:3037] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.655422 29691 tablet_bootstrap.cc:654] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.693408 29701 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 15:09:13.699120 29770 log.cc:924] Time spent T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.081s user 0.002s sys 0.000s
I20260807 15:09:13.699739 29742 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.714775 29744 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.644098 29724 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:13.734263 29693 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:13.734937 29693 ts_tablet_manager.cc:1397] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.266s user 0.010s sys 0.018s
I20260807 15:09:13.706508 29380 catalog_manager.cc:5495] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:13.793504 29569 raft_consensus.cc:2454] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:13.795853 29450 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:13.797860 29744 raft_consensus.cc:2781] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:13.798910 29744 raft_consensus.cc:686] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:13.801843 29742 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.808122 29742 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.801103 29744 consensus_queue.cc:237] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:13.814323 29533 consensus_peers.cc:487] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:13.814182 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:13.820480 29609 leader_election.cc:341] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:13.821627 29772 log.cc:924] Time spent T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.085s user 0.002s sys 0.000s
I20260807 15:09:13.831223 29645 raft_consensus.cc:2454] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:13.850217 29724 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.868515 29693 raft_consensus.cc:348] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.869554 29693 raft_consensus.cc:374] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.869890 29693 raft_consensus.cc:729] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.870803 29742 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.872006 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:13.873984 29692 tablet_bootstrap.cc:492] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:13.874511 29692 ts_tablet_manager.cc:1397] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.426s user 0.033s sys 0.028s
I20260807 15:09:13.876873 29691 tablet_bootstrap.cc:492] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:13.876698 29569 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:13.877442 29691 ts_tablet_manager.cc:1397] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.275s user 0.016s sys 0.023s
I20260807 15:09:13.879149 29608 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.879841 29692 raft_consensus.cc:348] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.881170 29692 raft_consensus.cc:374] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.881515 29692 raft_consensus.cc:729] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.882382 29692 consensus_queue.cc:260] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.882408 29691 raft_consensus.cc:348] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.883668 29691 raft_consensus.cc:374] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:13.884100 29691 raft_consensus.cc:729] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:13.883936 29742 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.887223 29742 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.886934 29691 consensus_queue.cc:260] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.888078 29742 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.890098 29692 ts_tablet_manager.cc:1428] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.015s user 0.003s sys 0.008s
I20260807 15:09:13.891096 29692 tablet_bootstrap.cc:492] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:13.893976 29693 consensus_queue.cc:260] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.898738 29764 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:13.899564 29764 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.906669 29764 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.907439 29691 ts_tablet_manager.cc:1428] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.030s user 0.009s sys 0.000s
I20260807 15:09:13.908712 29691 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:13.909580 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:13.913933 29609 leader_election.cc:341] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:13.922037 29449 consensus_peers.cc:487] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced -> Peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Couldn't send request to peer 4b092f7f951b4137b5d7810056684270. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:13.926412 29742 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.928714 29740 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.930495 29742 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:13.931761 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:09:13.934002 29609 leader_election.cc:341] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:13.934079 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:13.935213 29569 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.936880 29693 ts_tablet_manager.cc:1428] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.202s user 0.008s sys 0.011s
I20260807 15:09:13.937948 29693 tablet_bootstrap.cc:492] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:13.941285 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:13.944613 29570 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:13.948942 29608 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:13.951349 29742 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:13.952051 29742 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:13.952684 29742 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:13.954262 29724 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.956915 29740 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:13.960021 29691 tablet_bootstrap.cc:654] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:13.972301 29380 catalog_manager.cc:5495] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:13.977941 29692 tablet_bootstrap.cc:654] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
W20260807 15:09:13.977596 29609 consensus_peers.cc:487] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:13.992300 29742 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:13.999143 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:14.000114 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:14.001392 29567 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:14.002700 29609 leader_election.cc:341] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.004727 29742 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:14.015569 29693 tablet_bootstrap.cc:654] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.021886 29569 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:14.024312 29608 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:14.026335 29742 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:14.027227 29742 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:14.028909 29742 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.064774 29567 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:14.067312 29608 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:14.069988 29764 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:14.071086 29764 raft_consensus.cc:686] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:14.072763 29764 consensus_queue.cc:237] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.080551 29379 catalog_manager.cc:5495] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:14.089713 29692 tablet_bootstrap.cc:492] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:14.090422 29692 ts_tablet_manager.cc:1397] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.199s user 0.023s sys 0.028s
I20260807 15:09:14.105134 29693 tablet_bootstrap.cc:492] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:14.105835 29693 ts_tablet_manager.cc:1397] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.168s user 0.014s sys 0.020s
I20260807 15:09:14.111112 29692 raft_consensus.cc:348] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.112422 29692 raft_consensus.cc:374] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.112975 29691 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:14.112470 29693 raft_consensus.cc:348] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.113085 29692 raft_consensus.cc:729] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.113476 29691 ts_tablet_manager.cc:1397] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.205s user 0.011s sys 0.016s
I20260807 15:09:14.123788 29692 consensus_queue.cc:260] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.127069 29692 ts_tablet_manager.cc:1428] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.036s user 0.005s sys 0.006s
I20260807 15:09:14.127439 29693 raft_consensus.cc:374] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.127871 29693 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.128422 29764 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:14.128887 29693 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.135671 29693 ts_tablet_manager.cc:1428] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.029s user 0.005s sys 0.007s
I20260807 15:09:14.138648 29691 raft_consensus.cc:348] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.139834 29691 raft_consensus.cc:374] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.140172 29691 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.140959 29691 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.143077 29742 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:14.145071 29691 ts_tablet_manager.cc:1428] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.022s user 0.009s sys 0.001s
I20260807 15:09:14.149313 29691 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:14.154371 29693 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:14.137008 29692 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:14.157359 29382 catalog_manager.cc:5495] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:14.158758 29382 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:14.160369 29744 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.161350 29744 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.134020 29764 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:14.168910 29701 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.170377 29744 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:14.170558 29701 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.173801 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:14.174698 29701 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:14.176710 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:14.178122 29449 leader_election.cc:341] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.178295 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:14.179252 29450 leader_election.cc:341] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.178270 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:14.180063 29450 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:14.186645 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:14.188203 29744 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:14.189998 29701 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:14.201928 29692 tablet_bootstrap.cc:654] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.216120 29693 tablet_bootstrap.cc:654] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.221120 29691 tablet_bootstrap.cc:654] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.285341 29701 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:14.308378 29692 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:14.309015 29692 ts_tablet_manager.cc:1397] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.172s user 0.019s sys 0.009s
I20260807 15:09:14.314217 29487 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:14.314301 29692 raft_consensus.cc:348] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.315272 29692 raft_consensus.cc:374] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.315506 29693 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:14.315642 29692 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.316191 29693 ts_tablet_manager.cc:1397] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.162s user 0.024s sys 0.055s
I20260807 15:09:14.316607 29692 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.320223 29692 ts_tablet_manager.cc:1428] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 15:09:14.322553 29691 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:14.323060 29691 ts_tablet_manager.cc:1397] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.174s user 0.011s sys 0.021s
I20260807 15:09:14.322655 29693 raft_consensus.cc:348] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.323372 29693 raft_consensus.cc:374] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.323696 29693 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.324502 29693 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.326014 29691 raft_consensus.cc:348] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.326701 29691 raft_consensus.cc:374] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.326933 29691 raft_consensus.cc:729] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.327171 29693 ts_tablet_manager.cc:1428] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260807 15:09:14.328521 29693 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:14.328785 29692 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:14.327538 29691 consensus_queue.cc:260] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.350059 29701 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:14.351693 29691 ts_tablet_manager.cc:1428] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.028s user 0.004s sys 0.004s
I20260807 15:09:14.352869 29691 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:14.358105 29692 tablet_bootstrap.cc:654] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.379127 29693 tablet_bootstrap.cc:654] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.401281 29691 tablet_bootstrap.cc:654] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.435135 29693 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:14.435917 29693 ts_tablet_manager.cc:1397] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.108s user 0.020s sys 0.022s
I20260807 15:09:14.437228 29691 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:14.438021 29691 ts_tablet_manager.cc:1397] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.085s user 0.006s sys 0.023s
I20260807 15:09:14.448316 29693 raft_consensus.cc:348] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.449388 29693 raft_consensus.cc:374] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.449738 29693 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.450845 29693 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.453922 29691 raft_consensus.cc:348] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.454803 29691 raft_consensus.cc:374] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.455145 29691 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.456561 29692 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:14.456269 29691 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.457276 29692 ts_tablet_manager.cc:1397] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.129s user 0.043s sys 0.027s
I20260807 15:09:14.457773 29764 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.460840 29744 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.461933 29692 raft_consensus.cc:348] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.458580 29764 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.467025 29692 raft_consensus.cc:374] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.467414 29692 raft_consensus.cc:729] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.466840 29744 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.468339 29692 consensus_queue.cc:260] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.459153 29691 ts_tablet_manager.cc:1428] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.021s user 0.007s sys 0.004s
I20260807 15:09:14.470503 29691 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:14.470605 29744 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:14.472357 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:14.475255 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:14.478411 29609 leader_election.cc:341] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.478821 29692 ts_tablet_manager.cc:1428] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.021s user 0.008s sys 0.003s
I20260807 15:09:14.480456 29693 ts_tablet_manager.cc:1428] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.044s user 0.006s sys 0.004s
I20260807 15:09:14.480610 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:14.481667 29693 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:14.483026 29692 tablet_bootstrap.cc:492] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:14.484475 29740 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.485175 29740 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.490175 29764 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:14.491299 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:14.489928 29608 leader_election.cc:341] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.493081 29608 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:14.495492 29531 leader_election.cc:341] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.503577 29488 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:14.507433 29691 tablet_bootstrap.cc:654] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.507678 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:14.510270 29533 leader_election.cc:341] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.511020 29533 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:14.512030 29740 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:14.499257 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:14.516547 29748 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:14.526335 29693 tablet_bootstrap.cc:654] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.518461 29567 raft_consensus.cc:2379] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:14.513836 29764 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:14.541980 29748 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.542958 29748 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.551959 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:14.557485 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:14.559325 29699 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.559706 29762 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:14.560343 29699 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:14.561126 29533 leader_election.cc:341] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.564771 29450 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:14.549809 29748 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:14.571869 29609 consensus_peers.cc:487] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:14.567833 29744 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:14.567193 29531 leader_election.cc:341] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.576432 29531 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:14.580615 29740 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:14.594830 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:14.585388 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:14.597872 29691 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:14.604737 29691 ts_tablet_manager.cc:1397] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.134s user 0.019s sys 0.021s
I20260807 15:09:14.591387 29699 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:09:14.599059 29608 leader_election.cc:341] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.590757 29764 consensus_queue.cc:1035] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260807 15:09:14.612203 29609 leader_election.cc:341] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.616809 29692 tablet_bootstrap.cc:654] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.616729 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:14.619087 29699 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:14.621593 29744 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:14.625564 29693 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:14.626045 29693 ts_tablet_manager.cc:1397] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.145s user 0.025s sys 0.055s
I20260807 15:09:14.629508 29699 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:14.640959 29693 raft_consensus.cc:348] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.645124 29693 raft_consensus.cc:374] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.645723 29693 raft_consensus.cc:729] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.647039 29691 raft_consensus.cc:348] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.648253 29691 raft_consensus.cc:374] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.648586 29691 raft_consensus.cc:729] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.651371 29693 consensus_queue.cc:260] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.650434 29691 consensus_queue.cc:260] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.658380 29693 ts_tablet_manager.cc:1428] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.032s user 0.008s sys 0.003s
I20260807 15:09:14.659799 29693 tablet_bootstrap.cc:492] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:14.664793 29699 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.665575 29699 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.674269 29699 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:14.676159 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:14.680544 29691 ts_tablet_manager.cc:1428] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.075s user 0.009s sys 0.000s
I20260807 15:09:14.682255 29692 tablet_bootstrap.cc:492] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:14.682785 29692 ts_tablet_manager.cc:1397] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.200s user 0.021s sys 0.002s
I20260807 15:09:14.684067 29487 raft_consensus.cc:2454] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:14.680814 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:14.690112 29691 tablet_bootstrap.cc:492] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
W20260807 15:09:14.691110 29608 leader_election.cc:341] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.693152 29693 tablet_bootstrap.cc:654] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.700820 29609 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:14.702133 29742 raft_consensus.cc:2781] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:14.702906 29742 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:14.705090 29742 raft_consensus.cc:3037] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:14.705920 29692 raft_consensus.cc:348] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.706871 29692 raft_consensus.cc:374] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.707260 29692 raft_consensus.cc:729] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.708380 29692 consensus_queue.cc:260] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.712634 29692 ts_tablet_manager.cc:1428] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.030s user 0.010s sys 0.000s
I20260807 15:09:14.721525 29692 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:14.727525 29693 tablet_bootstrap.cc:492] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:14.728217 29693 ts_tablet_manager.cc:1397] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.019s
I20260807 15:09:14.732981 29744 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.732925 29693 raft_consensus.cc:348] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.733839 29693 raft_consensus.cc:374] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.734251 29693 raft_consensus.cc:729] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.733790 29744 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.735105 29693 consensus_queue.cc:260] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.739239 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:14.740593 29567 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:14.745712 29693 ts_tablet_manager.cc:1428] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.017s user 0.009s sys 0.000s
I20260807 15:09:14.746444 29693 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:14.751338 29450 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:14.743351 29692 tablet_bootstrap.cc:654] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.743780 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:14.757009 29644 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:14.752990 29744 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:14.757608 29742 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.752908 29701 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:14.768289 29691 tablet_bootstrap.cc:654] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.768787 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:14.769852 29488 raft_consensus.cc:3037] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:14.765211 29701 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:14.774169 29742 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:14.775298 29701 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:14.776603 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:09:14.778208 29608 leader_election.cc:341] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:14.789222 29488 raft_consensus.cc:2454] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:14.793217 29609 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
W20260807 15:09:14.794164 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:14.794983 29742 raft_consensus.cc:2781] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:14.795694 29742 raft_consensus.cc:686] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:14.797036 29742 consensus_queue.cc:237] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.798689 29701 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.800948 29693 tablet_bootstrap.cc:654] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.806924 29644 raft_consensus.cc:3037] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:14.807037 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:14.808243 29567 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:14.821372 29692 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:14.822028 29692 ts_tablet_manager.cc:1397] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.101s user 0.013s sys 0.011s
I20260807 15:09:14.808513 29701 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:14.824297 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:14.827075 29646 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:14.837706 29692 raft_consensus.cc:348] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.838877 29692 raft_consensus.cc:374] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.839373 29692 raft_consensus.cc:729] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.840152 29692 consensus_queue.cc:260] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.843387 29692 ts_tablet_manager.cc:1428] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.021s user 0.004s sys 0.006s
I20260807 15:09:14.844872 29692 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:14.850973 29382 catalog_manager.cc:5495] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:14.852795 29646 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:14.858292 29449 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:14.862039 29701 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:14.863036 29701 raft_consensus.cc:686] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:14.864506 29701 consensus_queue.cc:237] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.869242 29567 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:14.899052 29691 tablet_bootstrap.cc:492] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:14.899781 29691 ts_tablet_manager.cc:1397] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.210s user 0.023s sys 0.012s
I20260807 15:09:14.918443 29691 raft_consensus.cc:348] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.919603 29691 raft_consensus.cc:374] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:14.920020 29691 raft_consensus.cc:729] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:14.920948 29691 consensus_queue.cc:260] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:14.930773 29822 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:14.936553 29692 tablet_bootstrap.cc:654] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:14.935674 29691 ts_tablet_manager.cc:1428] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.035s user 0.009s sys 0.000s
I20260807 15:09:14.939792 29691 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:14.990127 29693 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:14.970732 29742 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:15.002454 29742 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.045819 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.046077 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.048841 29742 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:15.054170 29609 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.056599 29764 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:14.937783 29822 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.066512 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.079623 29693 ts_tablet_manager.cc:1397] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.333s user 0.029s sys 0.016s
I20260807 15:09:15.082152 29822 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.087165 29487 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.087720 29692 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:15.088225 29692 ts_tablet_manager.cc:1397] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.244s user 0.012s sys 0.008s
I20260807 15:09:15.090974 29693 raft_consensus.cc:348] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.091212 29692 raft_consensus.cc:348] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.091739 29693 raft_consensus.cc:374] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.091805 29692 raft_consensus.cc:374] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.092206 29692 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.092165 29693 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.093412 29693 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.093178 29692 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.099309 29693 ts_tablet_manager.cc:1428] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260807 15:09:15.099512 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.103185 29692 ts_tablet_manager.cc:1428] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260807 15:09:15.105100 29449 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:15.106205 29691 tablet_bootstrap.cc:654] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.108248 29692 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:15.108673 29693 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:15.120695 29701 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:15.127033 29692 tablet_bootstrap.cc:654] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.132272 29691 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:15.132803 29691 ts_tablet_manager.cc:1397] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.193s user 0.024s sys 0.032s
I20260807 15:09:15.134400 29693 tablet_bootstrap.cc:654] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.135252 29691 raft_consensus.cc:348] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.136068 29691 raft_consensus.cc:374] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.136662 29691 raft_consensus.cc:729] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.139215 29692 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:15.139739 29692 ts_tablet_manager.cc:1397] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.010s
I20260807 15:09:15.141741 29692 raft_consensus.cc:348] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.142287 29692 raft_consensus.cc:374] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.142508 29692 raft_consensus.cc:729] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.143079 29692 consensus_queue.cc:260] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.148113 29692 ts_tablet_manager.cc:1428] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 15:09:15.138370 29691 consensus_queue.cc:260] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.149104 29692 tablet_bootstrap.cc:492] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:15.156354 29691 ts_tablet_manager.cc:1428] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260807 15:09:15.157627 29691 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:15.155716 29380 catalog_manager.cc:5495] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:15.163275 29692 tablet_bootstrap.cc:654] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.167477 29815 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.168380 29815 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.169827 29693 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:15.173249 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.174299 29487 raft_consensus.cc:2379] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:15.168031 29740 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.176411 29740 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.179888 29815 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.182099 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.186960 29815 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:09:15.187825 29533 leader_election.cc:341] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.191937 29740 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.193871 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:15.225636 29531 leader_election.cc:341] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.226455 29531 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.195214 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.227977 29748 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:15.191639 29815 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.229660 29531 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.230419 29815 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.191679 29693 ts_tablet_manager.cc:1397] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.083s user 0.044s sys 0.019s
I20260807 15:09:15.231091 29815 raft_consensus.cc:3037] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.233323 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.234141 29644 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:15.235265 29693 raft_consensus.cc:348] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.236178 29693 raft_consensus.cc:374] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.236470 29693 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.203222 29691 tablet_bootstrap.cc:654] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.237362 29693 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.237604 29531 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:15.240191 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.241784 29487 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:15.244781 29693 ts_tablet_manager.cc:1428] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.013s user 0.005s sys 0.003s
I20260807 15:09:15.244722 29740 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:15.245352 29740 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:15.245958 29693 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:15.245911 29740 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.261096 29693 tablet_bootstrap.cc:654] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.261992 29815 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:15.263002 29692 tablet_bootstrap.cc:492] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:15.263545 29692 ts_tablet_manager.cc:1397] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.115s user 0.029s sys 0.062s
I20260807 15:09:15.267081 29740 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.267694 29692 raft_consensus.cc:348] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.268385 29692 raft_consensus.cc:374] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.268621 29692 raft_consensus.cc:729] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.270175 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:15.270948 29487 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.269362 29692 consensus_queue.cc:260] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.275388 29692 ts_tablet_manager.cc:1428] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.012s user 0.004s sys 0.002s
I20260807 15:09:15.276638 29692 tablet_bootstrap.cc:492] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:15.287524 29822 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.288682 29740 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.288280 29822 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.290534 29487 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:15.292580 29764 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:15.297089 29692 tablet_bootstrap.cc:654] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.295797 29822 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.298103 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.293517 29533 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:15.308706 29646 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:15.309849 29748 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:15.310542 29748 raft_consensus.cc:686] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:15.311244 29449 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:15.296445 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:15.293258 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.312036 29748 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.313133 29644 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.316351 29822 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:15.316852 29822 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:15.296660 29815 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.317278 29822 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.317919 29815 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.325942 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.328219 29815 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:15.331782 29531 leader_election.cc:341] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:15.333420 29450 leader_election.cc:341] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.349723 29742 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.355391 29693 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:15.355816 29693 ts_tablet_manager.cc:1397] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.110s user 0.014s sys 0.007s
I20260807 15:09:15.350804 29742 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.358855 29691 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:15.359262 29691 ts_tablet_manager.cc:1397] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.202s user 0.016s sys 0.010s
I20260807 15:09:15.363705 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.365556 29826 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:15.369504 29691 raft_consensus.cc:348] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.370052 29691 raft_consensus.cc:374] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.370216 29691 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.370944 29691 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.376788 29826 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:15.364737 29644 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:15.387645 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.389588 29693 raft_consensus.cc:348] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:15.390435 29609 leader_election.cc:341] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.397168 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.398059 29693 raft_consensus.cc:374] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.396571 29691 ts_tablet_manager.cc:1428] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.037s user 0.005s sys 0.001s
I20260807 15:09:15.398197 29567 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:15.398782 29693 raft_consensus.cc:729] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.400484 29608 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.401744 29762 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:15.396301 29742 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:15.401072 29693 consensus_queue.cc:260] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.406363 29692 tablet_bootstrap.cc:492] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:15.406940 29692 ts_tablet_manager.cc:1397] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.131s user 0.019s sys 0.030s
I20260807 15:09:15.404903 29691 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:15.402344 29762 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:15.413089 29379 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:15.416523 29701 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.416944 29693 ts_tablet_manager.cc:1428] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.061s user 0.005s sys 0.003s
I20260807 15:09:15.423269 29699 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:15.429490 29762 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.429051 29701 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:15.397166 29533 leader_election.cc:341] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.430470 29822 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.431470 29693 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:15.432904 29822 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.430501 29533 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.436360 29838 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:15.449141 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:15.441246 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.454061 29701 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:15.454314 29450 leader_election.cc:341] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.457551 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:15.461424 29646 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.464591 29843 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.470577 29693 tablet_bootstrap.cc:654] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
W20260807 15:09:15.472569 29450 leader_election.cc:341] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.466661 29748 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.478354 29691 tablet_bootstrap.cc:654] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.482115 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:15.490917 29449 leader_election.cc:341] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.465258 29843 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.489454 29748 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.491581 29449 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:15.507078 29826 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:15.511497 29692 raft_consensus.cc:348] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.512104 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.512532 29692 raft_consensus.cc:374] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.512854 29692 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.512904 29644 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:15.513777 29692 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.515033 29531 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:15.517282 29762 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.518492 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:15.520329 29609 leader_election.cc:341] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.521175 29646 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:15.521571 29838 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:15.522051 29838 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:15.522641 29838 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.523025 29843 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:15.524505 29449 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:15.525382 29826 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:15.525632 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:15.526538 29815 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.527134 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:15.527766 29609 leader_election.cc:341] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.527190 29815 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:15.529105 29533 leader_election.cc:341] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.529682 29748 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.530362 29815 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.532146 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.530542 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.526460 29826 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:15.539471 29692 ts_tablet_manager.cc:1428] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.132s user 0.006s sys 0.002s
I20260807 15:09:15.540532 29692 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
W20260807 15:09:15.545495 29533 leader_election.cc:341] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.550585 29838 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.552263 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.553028 29826 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:15.555869 29531 leader_election.cc:341] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.556504 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.559194 29748 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:15.543256 29569 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:15.562177 29762 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:15.567008 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:15.567684 29567 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.568275 29693 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:15.569077 29693 ts_tablet_manager.cc:1397] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.138s user 0.017s sys 0.014s
I20260807 15:09:15.572547 29693 raft_consensus.cc:348] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.573982 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:15.577558 29693 raft_consensus.cc:374] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.575757 29608 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:15.578168 29533 leader_election.cc:341] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.578349 29693 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.578755 29762 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:15.579443 29762 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:15.579916 29762 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.580379 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:15.581096 29646 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.580061 29693 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.583480 29693 ts_tablet_manager.cc:1428] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.014s user 0.004s sys 0.002s
I20260807 15:09:15.583300 29567 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:15.584460 29693 tablet_bootstrap.cc:492] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:15.584726 29608 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.585655 29764 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:15.586344 29764 raft_consensus.cc:686] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:15.587406 29764 consensus_queue.cc:237] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.574862 29838 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.599093 29691 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:15.599426 29691 ts_tablet_manager.cc:1397] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.195s user 0.029s sys 0.007s
I20260807 15:09:15.602510 29691 raft_consensus.cc:348] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.602989 29691 raft_consensus.cc:374] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.603161 29691 raft_consensus.cc:729] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.602587 29382 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:15.604417 29692 tablet_bootstrap.cc:654] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.604763 29762 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.603549 29691 consensus_queue.cc:260] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.608536 29691 ts_tablet_manager.cc:1428] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 15:09:15.609077 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:15.609405 29691 tablet_bootstrap.cc:492] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:15.609777 29487 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.607439 29378 catalog_manager.cc:5495] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:15.611932 29646 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:15.613399 29762 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:15.617672 29691 tablet_bootstrap.cc:654] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.617391 29531 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.617688 29693 tablet_bootstrap.cc:654] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.619498 29838 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:15.621495 29838 raft_consensus.cc:686] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:15.636458 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:15.638247 29567 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.637490 29838 consensus_queue.cc:237] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.640862 29487 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:15.647512 29691 tablet_bootstrap.cc:492] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:15.652578 29691 ts_tablet_manager.cc:1397] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.043s user 0.008s sys 0.005s
I20260807 15:09:15.655333 29692 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:15.660054 29692 ts_tablet_manager.cc:1397] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.120s user 0.015s sys 0.018s
I20260807 15:09:15.659278 29378 catalog_manager.cc:5495] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:15.655390 29691 raft_consensus.cc:348] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.661936 29691 raft_consensus.cc:374] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.662230 29691 raft_consensus.cc:729] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.662900 29691 consensus_queue.cc:260] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.663455 29692 raft_consensus.cc:348] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.660838 29609 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:15.664389 29692 raft_consensus.cc:374] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.664664 29692 raft_consensus.cc:729] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.665128 29762 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:15.665316 29692 consensus_queue.cc:260] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.665822 29762 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:15.666759 29762 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.667481 29567 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:15.669987 29692 ts_tablet_manager.cc:1428] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 15:09:15.670275 29691 ts_tablet_manager.cc:1428] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.017s user 0.003s sys 0.002s
I20260807 15:09:15.671267 29691 tablet_bootstrap.cc:492] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:15.671599 29692 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:15.678977 29693 tablet_bootstrap.cc:492] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:15.679508 29693 ts_tablet_manager.cc:1397] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.095s user 0.021s sys 0.028s
I20260807 15:09:15.696213 29692 tablet_bootstrap.cc:654] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.695894 29693 raft_consensus.cc:348] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.699361 29693 raft_consensus.cc:374] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.699641 29693 raft_consensus.cc:729] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.697762 29691 tablet_bootstrap.cc:654] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.701320 29693 consensus_queue.cc:260] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.708087 29826 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.708626 29826 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.708879 29378 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:15.712780 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.713466 29567 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:15.713533 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.714329 29691 tablet_bootstrap.cc:492] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:15.714809 29691 ts_tablet_manager.cc:1397] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.044s user 0.011s sys 0.002s
I20260807 15:09:15.714563 29646 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:15.715451 29450 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:15.716490 29822 raft_consensus.cc:2781] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:15.716965 29822 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:15.717316 29822 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.717885 29838 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:15.723690 29826 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.717967 29691 raft_consensus.cc:348] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.726827 29691 raft_consensus.cc:374] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.727185 29691 raft_consensus.cc:729] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.727823 29822 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.729079 29691 consensus_queue.cc:260] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.729724 29693 ts_tablet_manager.cc:1428] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.050s user 0.017s sys 0.000s
I20260807 15:09:15.733078 29693 tablet_bootstrap.cc:492] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:15.733520 29691 ts_tablet_manager.cc:1428] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.018s user 0.003s sys 0.003s
I20260807 15:09:15.733409 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:15.734601 29691 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:15.734381 29567 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.746599 29762 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.747419 29762 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.750972 29762 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:15.751308 29692 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:15.751972 29692 ts_tablet_manager.cc:1397] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.081s user 0.016s sys 0.026s
I20260807 15:09:15.752892 29693 tablet_bootstrap.cc:654] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.756330 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.756821 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.756963 29568 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:15.758140 29608 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:15.758829 29762 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 15:09:15.759045 29609 leader_election.cc:341] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.759231 29762 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:15.759774 29762 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.765441 29692 raft_consensus.cc:348] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.766372 29692 raft_consensus.cc:374] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.766678 29692 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.767352 29692 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.773664 29567 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:15.778440 29450 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:15.779410 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:15.780010 29701 raft_consensus.cc:2781] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:15.780334 29646 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.780910 29701 raft_consensus.cc:686] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:15.782354 29701 consensus_queue.cc:237] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.786849 29822 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.791803 29692 ts_tablet_manager.cc:1428] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.039s user 0.007s sys 0.000s
I20260807 15:09:15.793104 29692 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:15.795778 29646 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:15.810487 29691 tablet_bootstrap.cc:654] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.807144 29762 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.818007 29382 catalog_manager.cc:5495] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:15.816044 29838 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:15.825754 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:15.821126 29838 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:15.828274 29609 leader_election.cc:341] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:15.830439 29838 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.832559 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.834362 29646 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 1: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:15.832633 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:15.840021 29533 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.848259 29748 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.850458 29692 tablet_bootstrap.cc:654] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.850507 29815 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:15.869127 29762 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:15.872047 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:15.873139 29567 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.877523 29693 tablet_bootstrap.cc:492] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:15.878137 29693 ts_tablet_manager.cc:1397] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.145s user 0.009s sys 0.013s
I20260807 15:09:15.877812 29691 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:15.879276 29691 ts_tablet_manager.cc:1397] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.145s user 0.011s sys 0.047s
I20260807 15:09:15.883497 29693 raft_consensus.cc:348] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.884438 29693 raft_consensus.cc:374] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.884835 29693 raft_consensus.cc:729] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.885649 29693 consensus_queue.cc:260] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.883545 29748 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:15.902724 29693 ts_tablet_manager.cc:1428] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.024s user 0.005s sys 0.006s
I20260807 15:09:15.904244 29693 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:15.917456 29701 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:09:15.918741 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:15.918423 29701 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.924413 29567 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:15.925858 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:15.926245 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:15.927945 29568 raft_consensus.cc:2379] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:15.929683 29691 raft_consensus.cc:348] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.931051 29691 raft_consensus.cc:374] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.931382 29691 raft_consensus.cc:729] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.930456 29701 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:15.932572 29691 consensus_queue.cc:260] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.932631 29450 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:15.938016 29701 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:15.938407 29608 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:15.941440 29762 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:15.942269 29762 raft_consensus.cc:686] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:15.943627 29691 ts_tablet_manager.cc:1428] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.064s user 0.003s sys 0.006s
I20260807 15:09:15.945315 29762 consensus_queue.cc:237] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.954002 29691 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:15.958565 29822 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:15.970890 29692 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:15.971520 29692 ts_tablet_manager.cc:1397] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.179s user 0.028s sys 0.039s
I20260807 15:09:15.979147 29693 tablet_bootstrap.cc:654] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:15.980146 29701 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:15.986553 29692 raft_consensus.cc:348] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.988082 29692 raft_consensus.cc:374] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:15.988547 29692 raft_consensus.cc:729] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:15.989614 29692 consensus_queue.cc:260] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:15.993330 29692 ts_tablet_manager.cc:1428] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.021s user 0.008s sys 0.002s
I20260807 15:09:15.994702 29692 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:16.003486 29691 tablet_bootstrap.cc:654] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.009150 29692 tablet_bootstrap.cc:654] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.015916 29693 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:16.016511 29693 ts_tablet_manager.cc:1397] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.113s user 0.010s sys 0.014s
I20260807 15:09:16.017539 29762 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 15:09:16.020766 29693 raft_consensus.cc:348] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.029443 29693 raft_consensus.cc:374] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.029716 29693 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.040486 29693 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.045650 29701 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:16.049278 29762 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.049918 29762 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.050576 29693 ts_tablet_manager.cc:1428] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.034s user 0.007s sys 0.001s
I20260807 15:09:16.057535 29762 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:16.062834 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:16.062879 29693 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:16.077024 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:16.074836 29608 leader_election.cc:341] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:16.079485 29609 leader_election.cc:341] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.080302 29609 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:16.083015 29762 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:16.098047 29693 tablet_bootstrap.cc:654] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.097724 29748 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:16.100828 29762 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.101529 29762 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:16.103729 29533 consensus_peers.cc:487] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:16.104219 29692 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:16.104806 29692 ts_tablet_manager.cc:1397] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.110s user 0.015s sys 0.011s
I20260807 15:09:16.074362 29378 catalog_manager.cc:5495] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:16.152109 29748 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.104851 29762 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:16.156741 29748 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.161989 29846 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:16.179397 29691 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:16.179963 29691 ts_tablet_manager.cc:1397] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.226s user 0.031s sys 0.043s
I20260807 15:09:16.158465 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:16.185597 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:16.186064 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:16.186596 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:16.192221 29691 raft_consensus.cc:348] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.195253 29691 raft_consensus.cc:374] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.195636 29691 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.196604 29691 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:16.199477 29533 leader_election.cc:341] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.180919 29748 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:16.202239 29531 leader_election.cc:341] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.206108 29531 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:16.207553 29693 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:16.208140 29693 ts_tablet_manager.cc:1397] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.145s user 0.016s sys 0.023s
I20260807 15:09:16.211295 29691 ts_tablet_manager.cc:1428] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.031s user 0.008s sys 0.002s
I20260807 15:09:16.214803 29748 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 15:09:16.213275 29608 leader_election.cc:341] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.198302 29488 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:16.217831 29609 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:16.219544 29846 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:16.220084 29846 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:16.220498 29846 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.225368 29691 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:16.232347 29846 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.234454 29846 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:16.235262 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:16.236117 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:16.236191 29487 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.237946 29764 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 15:09:16.249142 29608 leader_election.cc:341] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.254145 29764 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:16.261261 29693 raft_consensus.cc:348] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.268041 29693 raft_consensus.cc:374] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.268152 29820 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.260535 29692 raft_consensus.cc:348] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.268548 29693 raft_consensus.cc:729] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.268989 29692 raft_consensus.cc:374] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.270615 29692 raft_consensus.cc:729] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.269006 29820 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.271384 29692 consensus_queue.cc:260] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.270084 29693 consensus_queue.cc:260] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.277483 29693 ts_tablet_manager.cc:1428] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.069s user 0.003s sys 0.005s
I20260807 15:09:16.282372 29693 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:16.290788 29692 ts_tablet_manager.cc:1428] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.137s user 0.010s sys 0.001s
I20260807 15:09:16.281213 29820 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:16.275650 29487 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:16.281250 29764 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.350791 29692 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
W20260807 15:09:16.296311 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 70732.8us
I20260807 15:09:16.372542 29764 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.375684 29764 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:16.295126 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:16.376114 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:16.377525 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:16.379611 29608 leader_election.cc:341] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.382720 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:16.383260 29609 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:16.394841 29691 tablet_bootstrap.cc:654] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.397717 29762 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:16.398545 29762 raft_consensus.cc:686] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:16.400104 29762 consensus_queue.cc:237] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:16.405977 29450 leader_election.cc:341] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:16.407542 29609 leader_election.cc:341] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.408334 29609 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:16.411674 29820 consensus_queue.cc:1035] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:16.415158 29764 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:16.422151 29693 tablet_bootstrap.cc:654] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
W20260807 15:09:16.423931 29449 leader_election.cc:341] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.426281 29449 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:16.431066 29701 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:16.432847 29692 tablet_bootstrap.cc:654] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.440230 29883 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 15:09:16.468940 29820 consensus_queue.cc:1035] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:16.470449 29880 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.471240 29880 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.480297 29691 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:16.487062 29691 ts_tablet_manager.cc:1397] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.262s user 0.014s sys 0.028s
I20260807 15:09:16.489840 29691 raft_consensus.cc:348] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:16.490875 29609 consensus_peers.cc:487] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:16.482445 29693 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:16.491940 29693 ts_tablet_manager.cc:1397] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.210s user 0.004s sys 0.025s
I20260807 15:09:16.481392 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:16.483067 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:16.496721 29531 leader_election.cc:341] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.497784 29693 raft_consensus.cc:348] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.498791 29693 raft_consensus.cc:374] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.499119 29693 raft_consensus.cc:729] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
W20260807 15:09:16.505503 29533 leader_election.cc:341] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.506330 29533 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:16.490897 29691 raft_consensus.cc:374] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.508021 29691 raft_consensus.cc:729] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.508762 29691 consensus_queue.cc:260] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.509183 29879 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:16.511569 29691 ts_tablet_manager.cc:1428] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.024s user 0.004s sys 0.002s
I20260807 15:09:16.482825 29880 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:16.517274 29691 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:16.517071 29693 consensus_queue.cc:260] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.523663 29693 ts_tablet_manager.cc:1428] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.031s user 0.009s sys 0.000s
I20260807 15:09:16.476359 29380 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:16.524905 29693 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:16.526852 29691 tablet_bootstrap.cc:654] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.533072 29692 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:16.533602 29692 ts_tablet_manager.cc:1397] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.183s user 0.026s sys 0.029s
I20260807 15:09:16.536819 29692 raft_consensus.cc:348] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.537668 29692 raft_consensus.cc:374] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.537961 29692 raft_consensus.cc:729] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.538652 29692 consensus_queue.cc:260] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.540796 29692 ts_tablet_manager.cc:1428] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 15:09:16.543782 29693 tablet_bootstrap.cc:654] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.547094 29692 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:16.553222 29691 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:16.553745 29691 ts_tablet_manager.cc:1397] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.000s
I20260807 15:09:16.556788 29691 raft_consensus.cc:348] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.557480 29691 raft_consensus.cc:374] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.557897 29691 raft_consensus.cc:729] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.558094 29692 tablet_bootstrap.cc:654] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.558629 29691 consensus_queue.cc:260] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.561874 29691 ts_tablet_manager.cc:1428] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 15:09:16.562989 29691 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:16.563740 29693 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:16.564293 29693 ts_tablet_manager.cc:1397] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.040s user 0.020s sys 0.005s
I20260807 15:09:16.567381 29693 raft_consensus.cc:348] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.568185 29693 raft_consensus.cc:374] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.568493 29693 raft_consensus.cc:729] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.569157 29693 consensus_queue.cc:260] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.571044 29693 ts_tablet_manager.cc:1428] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:09:16.572420 29693 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:16.582170 29485 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.583032 29691 tablet_bootstrap.cc:654] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.586613 29820 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.587824 29820 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.593160 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:16.594080 29820 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:16.594501 29567 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:16.597010 29450 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:16.598204 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:16.599264 29647 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:16.600015 29820 raft_consensus.cc:2781] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:16.600740 29820 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:16.601238 29820 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.599143 29692 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:16.604804 29692 ts_tablet_manager.cc:1397] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.058s user 0.017s sys 0.015s
I20260807 15:09:16.609046 29692 raft_consensus.cc:348] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.609776 29692 raft_consensus.cc:374] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.610076 29692 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.610852 29692 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.613750 29692 ts_tablet_manager.cc:1428] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20260807 15:09:16.614787 29692 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:16.620142 29693 tablet_bootstrap.cc:654] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.633378 29880 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.636566 29692 tablet_bootstrap.cc:654] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.634207 29880 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.650373 29838 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.651177 29838 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.658931 29838 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:16.661089 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:16.659248 29820 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.664280 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:16.665221 29646 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:16.666139 29820 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:16.667338 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:16.668102 29880 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:16.668268 29531 leader_election.cc:341] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.668377 29487 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:16.669593 29531 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:16.670866 29533 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:16.671713 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:16.672829 29879 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:16.673331 29838 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:16.673395 29879 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:16.674108 29879 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.674225 29838 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:16.671726 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:16.674924 29838 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.679513 29691 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:16.680117 29691 ts_tablet_manager.cc:1397] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.117s user 0.022s sys 0.014s
I20260807 15:09:16.676079 29568 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.672876 29646 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.689546 29691 raft_consensus.cc:348] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.690383 29691 raft_consensus.cc:374] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.690688 29691 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.690867 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:16.691450 29691 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.697263 29691 ts_tablet_manager.cc:1428] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.017s user 0.009s sys 0.000s
I20260807 15:09:16.698304 29691 tablet_bootstrap.cc:492] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:16.692498 29487 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:16.728621 29693 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:16.728750 29646 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:16.729902 29692 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:16.729152 29693 ts_tablet_manager.cc:1397] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.157s user 0.008s sys 0.048s
I20260807 15:09:16.730366 29692 ts_tablet_manager.cc:1397] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.116s user 0.011s sys 0.019s
I20260807 15:09:16.732625 29449 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:16.734143 29820 raft_consensus.cc:2781] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:16.734957 29820 raft_consensus.cc:686] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:16.732080 29568 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:16.736511 29838 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.743438 29691 tablet_bootstrap.cc:654] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.739882 29838 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:16.746356 29820 consensus_queue.cc:237] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.750752 29693 raft_consensus.cc:348] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.751631 29693 raft_consensus.cc:374] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.752051 29693 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.752715 29693 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.754530 29693 ts_tablet_manager.cc:1428] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.024s user 0.003s sys 0.002s
I20260807 15:09:16.748099 29879 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.749396 29692 raft_consensus.cc:348] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.756280 29693 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:16.756477 29692 raft_consensus.cc:374] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.757977 29692 raft_consensus.cc:729] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.761086 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:16.762089 29487 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.761572 29692 consensus_queue.cc:260] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.763720 29879 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:16.759656 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:16.766036 29692 ts_tablet_manager.cc:1428] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.035s user 0.005s sys 0.008s
I20260807 15:09:16.765774 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:16.767660 29692 tablet_bootstrap.cc:492] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:16.764735 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:16.770089 29647 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.775041 29485 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.767073 29646 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.803292 29646 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:16.803369 29382 catalog_manager.cc:5495] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:16.811363 29531 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:16.813512 29838 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:16.814409 29838 raft_consensus.cc:686] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:16.823769 29487 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:16.824108 29838 consensus_queue.cc:237] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.828766 29883 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:16.843784 29647 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:16.846885 29883 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.848332 29531 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:16.850948 29883 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:16.851903 29880 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:16.853505 29880 raft_consensus.cc:686] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:16.855139 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:16.857136 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:16.858377 29568 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:16.860082 29691 tablet_bootstrap.cc:492] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
W20260807 15:09:16.857218 29609 leader_election.cc:341] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:16.855160 29880 consensus_queue.cc:237] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.860605 29691 ts_tablet_manager.cc:1397] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.162s user 0.028s sys 0.018s
I20260807 15:09:16.860920 29608 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:16.868643 29884 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:16.869696 29691 raft_consensus.cc:348] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.870340 29884 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:16.872076 29485 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:16.875239 29691 raft_consensus.cc:374] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:16.877120 29691 raft_consensus.cc:729] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:16.875473 29693 tablet_bootstrap.cc:654] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.877818 29691 consensus_queue.cc:260] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:16.882289 29692 tablet_bootstrap.cc:654] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:16.882625 29691 ts_tablet_manager.cc:1428] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.022s user 0.009s sys 0.000s
I20260807 15:09:16.884073 29691 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:16.877166 29884 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.933789 29378 catalog_manager.cc:5495] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:16.964573 29568 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:16.966517 29691 tablet_bootstrap.cc:654] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
W20260807 15:09:17.003288 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 73152.3us
I20260807 15:09:17.011972 29693 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:17.013041 29693 ts_tablet_manager.cc:1397] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.257s user 0.050s sys 0.054s
I20260807 15:09:17.020612 29764 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.021584 29764 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.035531 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:17.038172 29608 leader_election.cc:341] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.038353 29880 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.040438 29879 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.048722 29879 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.049326 29764 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:17.039191 29880 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.043223 29762 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 15:09:17.056183 29879 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.058455 29378 catalog_manager.cc:5495] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:17.065457 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:17.068463 29880 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.071337 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:17.072317 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:17.072340 29487 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:17.063025 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:17.077900 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:17.081234 29693 raft_consensus.cc:348] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.082367 29693 raft_consensus.cc:374] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.082768 29693 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.083580 29693 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.081168 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:17.084363 29692 tablet_bootstrap.cc:492] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:17.085019 29692 ts_tablet_manager.cc:1397] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.318s user 0.012s sys 0.019s
W20260807 15:09:17.085009 29609 leader_election.cc:341] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.085170 29880 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:17.085855 29609 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:17.086177 29880 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:17.087059 29880 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:17.087399 29884 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:17.089509 29533 leader_election.cc:341] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.089802 29692 raft_consensus.cc:348] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.095052 29692 raft_consensus.cc:374] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.095436 29692 raft_consensus.cc:729] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.095881 29762 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:17.096819 29692 consensus_queue.cc:260] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.100261 29692 ts_tablet_manager.cc:1428] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.015s user 0.008s sys 0.001s
W20260807 15:09:17.100346 29531 leader_election.cc:341] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.101207 29531 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:17.095131 29883 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:17.103132 29838 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:17.104458 29692 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:17.104898 29838 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.105536 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:17.105587 29838 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.106628 29568 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.104667 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:17.111050 29838 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.090590 29884 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:17.085211 29691 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:17.118161 29691 ts_tablet_manager.cc:1397] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.234s user 0.016s sys 0.039s
W20260807 15:09:17.119156 29609 leader_election.cc:341] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.120380 29693 ts_tablet_manager.cc:1428] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.107s user 0.006s sys 0.004s
I20260807 15:09:17.122629 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:17.124991 29533 leader_election.cc:341] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.129842 29693 tablet_bootstrap.cc:492] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:17.131798 29820 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.132472 29820 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.134410 29820 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.136132 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:17.136699 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:17.127364 29691 raft_consensus.cc:348] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.138213 29691 raft_consensus.cc:374] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 15:09:17.138358 29450 leader_election.cc:341] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.138578 29691 raft_consensus.cc:729] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
W20260807 15:09:17.139768 29449 leader_election.cc:341] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.140079 29691 consensus_queue.cc:260] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.140717 29449 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:17.142164 29692 tablet_bootstrap.cc:654] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:17.142614 29820 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:17.150803 29691 ts_tablet_manager.cc:1428] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.032s user 0.005s sys 0.004s
I20260807 15:09:17.152098 29691 tablet_bootstrap.cc:492] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:17.152853 29568 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
W20260807 15:09:17.144484 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 46396.4us
I20260807 15:09:17.155501 29880 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.165304 29880 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.169868 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:17.155565 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:17.178985 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:17.180521 29693 tablet_bootstrap.cc:654] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:17.182389 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:17.192762 29691 tablet_bootstrap.cc:654] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:17.192395 29567 raft_consensus.cc:1226] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 15:09:17.193941 29820 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:17.197311 29692 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:17.197757 29692 ts_tablet_manager.cc:1397] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.094s user 0.011s sys 0.017s
W20260807 15:09:17.203558 29531 leader_election.cc:341] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.204082 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:17.204669 29608 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:17.205724 29909 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:17.206216 29909 raft_consensus.cc:686] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:17.207508 29909 consensus_queue.cc:237] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.206529 29884 consensus_queue.cc:1046] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260807 15:09:17.212363 29762 raft_consensus.cc:3032] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:17.212765 29762 raft_consensus.cc:729] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:17.213245 29692 raft_consensus.cc:348] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.213958 29692 raft_consensus.cc:374] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.214226 29692 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.213672 29762 consensus_queue.cc:260] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.214823 29692 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.218554 29692 ts_tablet_manager.cc:1428] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.021s user 0.006s sys 0.001s
I20260807 15:09:17.219591 29692 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:17.225106 29693 tablet_bootstrap.cc:492] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:17.225777 29693 ts_tablet_manager.cc:1397] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.096s user 0.018s sys 0.012s
I20260807 15:09:17.228417 29692 tablet_bootstrap.cc:654] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:17.205328 29880 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:17.229166 29693 raft_consensus.cc:348] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.232664 29693 raft_consensus.cc:374] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.232985 29693 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.233481 29691 tablet_bootstrap.cc:492] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:17.233925 29691 ts_tablet_manager.cc:1397] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.082s user 0.010s sys 0.007s
I20260807 15:09:17.233708 29693 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.237099 29693 ts_tablet_manager.cc:1428] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.011s user 0.008s sys 0.001s
I20260807 15:09:17.238034 29693 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:17.242909 29762 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:17.241606 29531 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:17.248172 29879 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:09:17.262423 29691 raft_consensus.cc:348] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.263449 29691 raft_consensus.cc:374] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.263931 29691 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.264763 29691 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.267118 29379 catalog_manager.cc:5495] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:17.284252 29693 tablet_bootstrap.cc:654] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:17.292424 29879 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:17.296062 29691 ts_tablet_manager.cc:1428] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.062s user 0.008s sys 0.003s
I20260807 15:09:17.297554 29691 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:17.293300 29905 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:17.302103 29884 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.308713 29884 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.318909 29820 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.319396 29822 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.319612 29820 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.320196 29822 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.324047 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:17.324648 29884 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:17.325168 29569 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:17.327595 29450 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:17.328876 29905 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:17.329586 29905 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:17.330255 29905 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.330004 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:17.332933 29879 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:17.335088 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:17.335167 29609 leader_election.cc:341] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.342046 29822 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.348664 29820 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.374346 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:17.370744 29884 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.379995 29569 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:17.386340 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:17.388753 29450 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:17.392123 29826 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:17.392786 29826 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:17.393558 29826 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.395152 29884 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.401399 29884 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:17.402776 29645 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
W20260807 15:09:17.404538 29449 leader_election.cc:341] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.420945 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:17.421643 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:17.423041 29568 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:17.462496 29692 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:17.462944 29692 ts_tablet_manager.cc:1397] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.244s user 0.027s sys 0.011s
I20260807 15:09:17.467346 29879 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.469570 29608 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:17.470191 29919 log.cc:924] Time spent T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.073s user 0.000s sys 0.001s
I20260807 15:09:17.469796 29879 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.473148 29909 raft_consensus.cc:2781] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:17.473664 29909 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:17.474308 29909 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.469774 29880 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260807 15:09:17.519846 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50456.4us
I20260807 15:09:17.480007 29879 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.545868 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:17.550475 29567 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:17.557518 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:17.558570 29646 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:17.623432 29693 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:17.624191 29693 ts_tablet_manager.cc:1397] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.386s user 0.035s sys 0.064s
I20260807 15:09:17.623432 29692 raft_consensus.cc:348] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.625494 29692 raft_consensus.cc:374] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.625782 29692 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.628309 29692 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.638883 29909 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.640059 29691 tablet_bootstrap.cc:654] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:17.632979 29826 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.639911 29531 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:17.646220 29879 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:17.647461 29815 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:17.648185 29815 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:17.648763 29815 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.646937 29879 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.652505 29909 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:17.652591 29693 raft_consensus.cc:348] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.653533 29879 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.653578 29693 raft_consensus.cc:374] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.654812 29693 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.655287 29693 consensus_queue.cc:260] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.661547 29826 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.675004 29692 ts_tablet_manager.cc:1428] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.212s user 0.026s sys 0.032s
I20260807 15:09:17.645669 29905 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.686640 29693 ts_tablet_manager.cc:1428] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.062s user 0.006s sys 0.002s
I20260807 15:09:17.687799 29693 tablet_bootstrap.cc:492] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:17.687981 29692 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:17.653957 29608 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:17.699555 29485 raft_consensus.cc:2379] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 1: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:17.695149 29815 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.708372 29909 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 15:09:17.708220 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 54383.8us
I20260807 15:09:17.709245 29909 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:17.709957 29909 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:17.690701 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 53362.6us
I20260807 15:09:17.716518 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:17.718780 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:17.722560 29693 tablet_bootstrap.cc:654] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:17.728479 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:17.723659 29815 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:17.719712 29569 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.741819 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:17.722963 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:17.748323 29909 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.764263 29909 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:09:17.789136 29449 leader_election.cc:341] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.816551 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:17.817579 29646 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.828188 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:17.854105 29905 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:17.865545 29531 leader_election.cc:341] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.864984 29568 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.874678 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:17.887773 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:17.896420 29692 tablet_bootstrap.cc:654] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:17.863675 29646 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:17.898483 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:17.900645 29567 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.901557 29568 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:17.908349 29645 raft_consensus.cc:2379] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:17.912225 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:17.915316 29693 tablet_bootstrap.cc:492] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:17.916030 29693 ts_tablet_manager.cc:1397] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.228s user 0.021s sys 0.016s
I20260807 15:09:17.905086 29569 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:17.914769 29486 raft_consensus.cc:2379] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 1: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:17.922886 29691 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:17.923632 29691 ts_tablet_manager.cc:1397] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.626s user 0.073s sys 0.072s
I20260807 15:09:17.925956 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:17.929859 29450 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:17.932579 29925 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:17.933140 29925 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:17.935837 29693 raft_consensus.cc:348] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.936764 29693 raft_consensus.cc:374] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.937038 29693 raft_consensus.cc:729] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.937717 29693 consensus_queue.cc:260] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.935994 29925 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.943928 29693 ts_tablet_manager.cc:1428] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.027s user 0.001s sys 0.006s
I20260807 15:09:17.945254 29693 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:17.947160 29487 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:17.960098 29691 raft_consensus.cc:348] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.963197 29691 raft_consensus.cc:374] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:17.963487 29691 raft_consensus.cc:729] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:17.964103 29691 consensus_queue.cc:260] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:17.973086 29450 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:17.974088 29884 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:17.974812 29692 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:17.975847 29692 ts_tablet_manager.cc:1397] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.288s user 0.023s sys 0.010s
W20260807 15:09:17.977394 29609 leader_election.cc:341] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.976504 29905 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260807 15:09:17.978538 29533 leader_election.cc:341] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:17.981567 29533 leader_election.cc:341] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:17.982262 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:17.983179 29879 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:17.979382 29567 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:17.994642 29691 ts_tablet_manager.cc:1428] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.070s user 0.004s sys 0.004s
I20260807 15:09:17.995404 29691 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:17.996225 29879 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:17.984776 29608 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:18.013592 29693 tablet_bootstrap.cc:654] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.027731 29693 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:18.028369 29693 ts_tablet_manager.cc:1397] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.083s user 0.014s sys 0.010s
I20260807 15:09:18.033015 29693 raft_consensus.cc:348] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.033818 29693 raft_consensus.cc:374] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.034083 29693 raft_consensus.cc:729] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.034740 29693 consensus_queue.cc:260] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.037390 29693 ts_tablet_manager.cc:1428] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260807 15:09:18.038399 29693 tablet_bootstrap.cc:492] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:18.042132 29884 raft_consensus.cc:2781] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:18.043459 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:18.044833 29909 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.045385 29909 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.043502 29884 raft_consensus.cc:686] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:18.047676 29692 raft_consensus.cc:348] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.048442 29909 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:18.049168 29884 consensus_queue.cc:237] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.049883 29925 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:09:18.045708 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 67533.7us
W20260807 15:09:18.057830 29609 consensus_peers.cc:487] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:18.051496 29925 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.048522 29692 raft_consensus.cc:374] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.060993 29692 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.062114 29693 tablet_bootstrap.cc:654] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.061721 29692 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.069412 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:18.094236 29609 leader_election.cc:341] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.094570 29925 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.095835 29692 ts_tablet_manager.cc:1428] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.119s user 0.009s sys 0.000s
I20260807 15:09:18.096889 29692 tablet_bootstrap.cc:492] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:18.105768 29691 tablet_bootstrap.cc:654] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.113267 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.115767 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.117322 29378 catalog_manager.cc:5495] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
W20260807 15:09:18.121341 29449 leader_election.cc:341] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.136543 29531 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:18.139387 29927 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:18.140573 29927 raft_consensus.cc:686] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:18.142495 29927 consensus_queue.cc:237] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:18.169298 29450 leader_election.cc:341] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:18.178007 29533 leader_election.cc:341] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.185542 29691 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:18.186230 29691 ts_tablet_manager.cc:1397] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.191s user 0.018s sys 0.041s
I20260807 15:09:18.188241 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.174117 29450 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:18.205884 29693 tablet_bootstrap.cc:492] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:18.206444 29693 ts_tablet_manager.cc:1397] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.168s user 0.020s sys 0.040s
I20260807 15:09:18.198679 29905 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:18.191131 29608 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:18.216812 29884 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:18.217808 29884 raft_consensus.cc:686] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:18.219167 29884 consensus_queue.cc:237] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.223044 29691 raft_consensus.cc:348] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.219010 29693 raft_consensus.cc:348] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.227702 29693 raft_consensus.cc:374] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.228108 29693 raft_consensus.cc:729] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.228804 29693 consensus_queue.cc:260] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:18.229857 29608 leader_election.cc:341] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.232345 29608 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:18.234395 29693 ts_tablet_manager.cc:1428] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.028s user 0.009s sys 0.001s
I20260807 15:09:18.235756 29693 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:18.237473 29909 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:18.233058 29692 tablet_bootstrap.cc:654] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.246722 29691 raft_consensus.cc:374] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.247239 29691 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.250208 29691 consensus_queue.cc:260] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.264292 29691 ts_tablet_manager.cc:1428] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.078s user 0.008s sys 0.002s
I20260807 15:09:18.265468 29691 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:18.267609 29692 tablet_bootstrap.cc:492] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:18.268286 29692 ts_tablet_manager.cc:1397] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.172s user 0.019s sys 0.009s
I20260807 15:09:18.208875 29379 catalog_manager.cc:5495] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:18.315725 29382 catalog_manager.cc:5495] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:18.334360 29693 tablet_bootstrap.cc:654] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.331493 29692 raft_consensus.cc:348] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.334903 29692 raft_consensus.cc:374] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.335426 29692 raft_consensus.cc:729] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.338557 29692 consensus_queue.cc:260] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.356518 29692 ts_tablet_manager.cc:1428] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.087s user 0.008s sys 0.004s
I20260807 15:09:18.373135 29692 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:18.380641 29905 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.382125 29905 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.387208 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.388376 29569 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:18.389431 29905 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.392418 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.395684 29450 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:18.397091 29820 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:18.397512 29820 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:18.397890 29820 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:18.397971 29449 leader_election.cc:341] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.403364 29927 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.404073 29927 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.408018 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:18.410180 29533 leader_election.cc:341] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.411990 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.412982 29646 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:18.414778 29762 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.414235 29927 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.415558 29762 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.417896 29531 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:18.419807 29762 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:18.421078 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.421679 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:18.422454 29927 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:18.425640 29927 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:18.426164 29927 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.429194 29692 tablet_bootstrap.cc:654] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.422468 29486 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
W20260807 15:09:18.422741 29608 leader_election.cc:341] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.434278 29691 tablet_bootstrap.cc:654] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.438369 29609 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:18.423000 29820 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.440222 29693 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:18.442461 29884 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:18.442941 29884 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:18.443481 29884 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.444309 29820 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.445264 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:18.446027 29566 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.463706 29820 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260807 15:09:18.473385 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:09:18.475412 29449 consensus_peers.cc:487] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced -> Peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Couldn't send request to peer 4b092f7f951b4137b5d7810056684270. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:18.486310 29693 ts_tablet_manager.cc:1397] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.251s user 0.017s sys 0.013s
W20260807 15:09:18.489725 29449 leader_election.cc:341] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.490664 29909 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:18.495672 29566 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:18.498895 29450 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:18.502233 29905 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:18.501139 29927 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.502780 29693 raft_consensus.cc:348] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.503798 29693 raft_consensus.cc:374] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.504172 29693 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.503683 29905 raft_consensus.cc:686] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:18.507211 29692 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:18.507809 29692 ts_tablet_manager.cc:1397] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.135s user 0.022s sys 0.034s
I20260807 15:09:18.506656 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:18.505605 29905 consensus_queue.cc:237] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:18.509546 29533 leader_election.cc:341] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.505043 29693 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:18.513087 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:18.513681 29693 ts_tablet_manager.cc:1428] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260807 15:09:18.508912 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:18.514204 29646 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.506970 29927 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.521231 29820 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.521651 29691 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:18.522297 29691 ts_tablet_manager.cc:1397] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.257s user 0.013s sys 0.013s
I20260807 15:09:18.521908 29820 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.523061 29693 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:18.525544 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.526254 29820 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:18.527205 29449 leader_election.cc:341] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.517349 29884 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.528193 29692 raft_consensus.cc:348] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.529793 29692 raft_consensus.cc:374] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.530126 29692 raft_consensus.cc:729] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.525373 29691 raft_consensus.cc:348] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.530723 29691 raft_consensus.cc:374] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.531000 29691 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.531791 29691 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.532972 29692 consensus_queue.cc:260] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.535287 29692 ts_tablet_manager.cc:1428] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.027s user 0.001s sys 0.004s
I20260807 15:09:18.537667 29646 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:18.538648 29531 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:18.539978 29927 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:18.540475 29927 raft_consensus.cc:686] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:18.541466 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:18.541402 29927 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.542160 29486 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.543923 29693 tablet_bootstrap.cc:654] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.544129 29379 catalog_manager.cc:5495] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:18.549153 29691 ts_tablet_manager.cc:1428] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20260807 15:09:18.550616 29691 tablet_bootstrap.cc:492] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:18.528942 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.555639 29693 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:18.551785 29692 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:18.556166 29693 ts_tablet_manager.cc:1397] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.011s
I20260807 15:09:18.558826 29693 raft_consensus.cc:348] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.559557 29693 raft_consensus.cc:374] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.561259 29693 raft_consensus.cc:729] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.561995 29693 consensus_queue.cc:260] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.565753 29693 ts_tablet_manager.cc:1428] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.009s user 0.004s sys 0.002s
I20260807 15:09:18.569077 29693 tablet_bootstrap.cc:492] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:18.577252 29884 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:09:18.578171 29609 consensus_peers.cc:487] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:18.578683 29566 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
W20260807 15:09:18.579839 29533 consensus_peers.cc:487] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:18.580160 29921 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:18.580713 29921 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.581467 29450 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:18.582983 29921 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.583307 29925 raft_consensus.cc:2781] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:18.583747 29925 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:18.584120 29925 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.584867 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.585649 29644 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:18.586783 29692 tablet_bootstrap.cc:654] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.587424 29449 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:18.594769 29486 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:18.595980 29820 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:18.596062 29609 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:18.596468 29820 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:18.596819 29820 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:18.597425 29884 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:18.597931 29884 raft_consensus.cc:686] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:18.598786 29884 consensus_queue.cc:237] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.601257 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.603123 29691 tablet_bootstrap.cc:654] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.603531 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:18.603531 29569 raft_consensus.cc:2379] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:09:18.609964 29608 leader_election.cc:341] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.607725 29379 catalog_manager.cc:5495] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:18.619999 29925 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.628098 29820 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.634052 29378 catalog_manager.cc:5495] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:18.635414 29693 tablet_bootstrap.cc:654] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.636786 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:18.636852 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:18.637351 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:18.637852 29566 raft_consensus.cc:2379] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:09:18.637949 29569 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:18.638281 29449 leader_election.cc:341] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.640340 29820 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.646842 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:18.648033 29569 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:18.639077 29925 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.648072 29382 catalog_manager.cc:5495] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:18.650957 29450 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:18.652170 29820 raft_consensus.cc:2781] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:18.652980 29820 raft_consensus.cc:686] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:18.654014 29820 consensus_queue.cc:237] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.644423 29905 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.657111 29905 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.658200 29646 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:18.661496 29449 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:18.662014 29905 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.670555 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.674913 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.677597 29449 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:18.678321 29820 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:18.670977 29905 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:18.683661 29691 tablet_bootstrap.cc:492] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:18.683611 29905 raft_consensus.cc:686] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:18.684274 29691 ts_tablet_manager.cc:1397] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.134s user 0.010s sys 0.005s
I20260807 15:09:18.688287 29691 raft_consensus.cc:348] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.689250 29691 raft_consensus.cc:374] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.689579 29691 raft_consensus.cc:729] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.690387 29691 consensus_queue.cc:260] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.693038 29691 ts_tablet_manager.cc:1428] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20260807 15:09:18.693399 29692 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:18.693893 29692 ts_tablet_manager.cc:1397] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.142s user 0.014s sys 0.018s
I20260807 15:09:18.694043 29691 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:18.690333 29905 consensus_queue.cc:237] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.700253 29692 raft_consensus.cc:348] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.712771 29692 raft_consensus.cc:374] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.713099 29692 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.713722 29692 consensus_queue.cc:260] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.718336 29382 catalog_manager.cc:5495] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:18.719730 29692 ts_tablet_manager.cc:1428] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.025s user 0.003s sys 0.005s
I20260807 15:09:18.720345 29691 tablet_bootstrap.cc:654] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.720098 29382 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 2 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:18.723444 29692 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:18.725607 29691 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:18.726063 29691 ts_tablet_manager.cc:1397] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.001s
I20260807 15:09:18.723496 29693 tablet_bootstrap.cc:492] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:18.727636 29693 ts_tablet_manager.cc:1397] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.159s user 0.024s sys 0.012s
I20260807 15:09:18.731609 29692 tablet_bootstrap.cc:654] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.731607 29691 raft_consensus.cc:348] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.733626 29691 raft_consensus.cc:374] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.733963 29691 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.734695 29691 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.735401 29693 raft_consensus.cc:348] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.736155 29693 raft_consensus.cc:374] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.736423 29693 raft_consensus.cc:729] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.737097 29693 consensus_queue.cc:260] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.739274 29693 ts_tablet_manager.cc:1428] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260807 15:09:18.737102 29691 ts_tablet_manager.cc:1428] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260807 15:09:18.740592 29691 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:18.743098 29693 tablet_bootstrap.cc:492] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:18.749421 29884 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.754246 29884 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.753157 29691 tablet_bootstrap.cc:654] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.756817 29692 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:18.757310 29692 ts_tablet_manager.cc:1397] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.034s user 0.013s sys 0.015s
I20260807 15:09:18.758538 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:18.758688 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.759765 29692 raft_consensus.cc:348] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:18.760142 29609 leader_election.cc:341] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.760488 29692 raft_consensus.cc:374] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.760778 29692 raft_consensus.cc:729] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.761379 29692 consensus_queue.cc:260] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.762389 29693 tablet_bootstrap.cc:654] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.763633 29692 ts_tablet_manager.cc:1428] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:09:18.764714 29692 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:18.769492 29691 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:18.770002 29691 ts_tablet_manager.cc:1397] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.000s
I20260807 15:09:18.770226 29692 tablet_bootstrap.cc:654] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.773232 29693 tablet_bootstrap.cc:492] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:18.773030 29691 raft_consensus.cc:348] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.773881 29693 ts_tablet_manager.cc:1397] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.004s
W20260807 15:09:18.773571 29608 leader_election.cc:341] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.773806 29691 raft_consensus.cc:374] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.774544 29691 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.774499 29608 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:18.775511 29691 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.776640 29693 raft_consensus.cc:348] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.777339 29693 raft_consensus.cc:374] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.777621 29693 raft_consensus.cc:729] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.778164 29691 ts_tablet_manager.cc:1428] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260807 15:09:18.778590 29693 consensus_queue.cc:260] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.778941 29953 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:18.779189 29691 tablet_bootstrap.cc:492] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:18.784232 29764 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:18.785465 29693 ts_tablet_manager.cc:1428] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260807 15:09:18.786427 29691 tablet_bootstrap.cc:654] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.786705 29693 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:18.792500 29693 tablet_bootstrap.cc:654] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.809978 29884 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:18.812847 29691 tablet_bootstrap.cc:492] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:18.813365 29691 ts_tablet_manager.cc:1397] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.006s
I20260807 15:09:18.813949 29927 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:18.817142 29884 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:18.818513 29691 raft_consensus.cc:348] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.822002 29693 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:18.822237 29691 raft_consensus.cc:374] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.822544 29693 ts_tablet_manager.cc:1397] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.008s
I20260807 15:09:18.822628 29691 raft_consensus.cc:729] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.823571 29691 consensus_queue.cc:260] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.826504 29691 ts_tablet_manager.cc:1428] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260807 15:09:18.828569 29691 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:18.836196 29692 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:18.836793 29692 ts_tablet_manager.cc:1397] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.072s user 0.019s sys 0.030s
I20260807 15:09:18.834501 29693 raft_consensus.cc:348] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.837846 29693 raft_consensus.cc:374] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.838212 29693 raft_consensus.cc:729] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.839088 29693 consensus_queue.cc:260] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.844296 29764 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.845082 29764 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.856254 29693 ts_tablet_manager.cc:1428] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.033s user 0.006s sys 0.006s
I20260807 15:09:18.859364 29764 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:18.863370 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:18.863405 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:18.865644 29609 leader_election.cc:341] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:18.866158 29608 leader_election.cc:341] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:18.866577 29608 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:18.867630 29762 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:18.866222 29693 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:18.879631 29484 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.881525 29692 raft_consensus.cc:348] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.882386 29692 raft_consensus.cc:374] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.882664 29692 raft_consensus.cc:729] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.883296 29691 tablet_bootstrap.cc:654] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.888099 29692 consensus_queue.cc:260] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.898106 29692 ts_tablet_manager.cc:1428] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.061s user 0.008s sys 0.001s
I20260807 15:09:18.899204 29692 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:18.903831 29693 tablet_bootstrap.cc:654] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.906015 29905 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.906525 29905 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.909188 29905 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.911006 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.911633 29646 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:18.912304 29692 tablet_bootstrap.cc:654] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.913784 29449 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:18.916607 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.917428 29569 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:18.919348 29905 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:18.924113 29691 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:18.924682 29691 ts_tablet_manager.cc:1397] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.096s user 0.013s sys 0.022s
I20260807 15:09:18.924991 29905 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:18.925503 29905 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.927353 29692 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:18.927448 29691 raft_consensus.cc:348] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.928529 29691 raft_consensus.cc:374] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.928819 29691 raft_consensus.cc:729] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.929423 29692 ts_tablet_manager.cc:1397] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.002s
I20260807 15:09:18.929745 29691 consensus_queue.cc:260] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.932111 29691 ts_tablet_manager.cc:1428] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 15:09:18.933109 29691 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:18.934921 29692 raft_consensus.cc:348] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.937790 29692 raft_consensus.cc:374] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:18.938462 29692 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:18.940353 29691 tablet_bootstrap.cc:654] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.939925 29692 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.943027 29905 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.944608 29692 ts_tablet_manager.cc:1428] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260807 15:09:18.948853 29692 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:18.956426 29925 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.957048 29925 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.960865 29921 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:18.961526 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.961496 29921 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:18.949899 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:18.965258 29569 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:18.966500 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.964607 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:18.969863 29449 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:18.964659 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:18.963814 29921 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.979391 29692 tablet_bootstrap.cc:654] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:18.972146 29820 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:18.992354 29450 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:18.959713 29925 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:18.993556 29921 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.000264 29921 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.001027 29820 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:19.003228 29884 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.003939 29884 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.007122 29569 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:19.007292 29880 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.007772 29880 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.008508 29884 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:19.015360 29927 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.024237 29921 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.022298 29927 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.020479 29450 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:19.026424 29927 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.026577 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:19.027288 29644 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:19.027839 29880 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.028600 29449 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:19.028800 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:19.029317 29921 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:19.029551 29925 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:19.029872 29921 raft_consensus.cc:686] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:19.030012 29925 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:19.030164 29693 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:19.030449 29925 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.030663 29693 ts_tablet_manager.cc:1397] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.165s user 0.013s sys 0.050s
I20260807 15:09:19.029472 29645 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:19.030793 29921 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.031909 29905 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.034171 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:19.033169 29531 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:19.034878 29646 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.035660 29927 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:19.036062 29927 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:19.036420 29927 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.038164 29693 raft_consensus.cc:348] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.032265 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:19.057947 29484 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:19.055466 29449 consensus_peers.cc:487] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced -> Peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Couldn't send request to peer 4b092f7f951b4137b5d7810056684270. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:19.040881 29693 raft_consensus.cc:374] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.039606 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:19.059393 29693 raft_consensus.cc:729] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.041846 29644 raft_consensus.cc:2396] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260807 15:09:19.060709 29450 leader_election.cc:341] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.055975 29927 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.047515 29820 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260807 15:09:19.072938 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:19.073567 29644 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.062408 29693 consensus_queue.cc:260] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.039113 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:19.075103 29569 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 1: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:09:19.063848 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.076022 29486 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:19.058235 29925 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.077876 29693 ts_tablet_manager.cc:1428] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.047s user 0.005s sys 0.005s
I20260807 15:09:19.044939 29646 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:19.079355 29693 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:19.079639 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:19.080376 29691 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:19.081018 29691 ts_tablet_manager.cc:1397] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.148s user 0.031s sys 0.045s
W20260807 15:09:19.081171 29450 leader_election.cc:341] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.082154 29925 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.083204 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:19.083926 29646 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.085758 29691 raft_consensus.cc:348] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.086745 29691 raft_consensus.cc:374] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.087100 29691 raft_consensus.cc:729] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.090471 29692 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:19.092619 29692 ts_tablet_manager.cc:1397] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.144s user 0.013s sys 0.000s
I20260807 15:09:19.095793 29692 raft_consensus.cc:348] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.096735 29692 raft_consensus.cc:374] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.104984 29692 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.105659 29692 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.100570 29691 consensus_queue.cc:260] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.110018 29691 ts_tablet_manager.cc:1428] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260807 15:09:19.110704 29927 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.113178 29692 ts_tablet_manager.cc:1428] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.020s user 0.004s sys 0.003s
I20260807 15:09:19.114615 29692 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:19.097177 29645 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.118775 29646 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:19.120555 29693 tablet_bootstrap.cc:654] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.095865 29644 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:19.122615 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.125496 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.126367 29485 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:19.126816 29531 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:19.127722 29815 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:19.128116 29487 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.128247 29815 raft_consensus.cc:686] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:19.129104 29815 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.130091 29692 tablet_bootstrap.cc:654] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.132418 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:19.133003 29485 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.134440 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:19.135610 29609 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
W20260807 15:09:19.136320 29533 consensus_peers.cc:487] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:19.137140 29884 raft_consensus.cc:2741] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 15:09:19.138172 29879 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:19.143651 29927 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:19.148386 29485 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:19.165068 29921 consensus_queue.cc:1035] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:19.166572 29567 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.167428 29449 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:19.165418 29692 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:19.166591 29646 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.169695 29692 ts_tablet_manager.cc:1397] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.055s user 0.011s sys 0.006s
I20260807 15:09:19.173563 29691 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:19.165635 29382 catalog_manager.cc:5495] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:19.172848 29921 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:19.178633 29921 raft_consensus.cc:686] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:19.179760 29921 consensus_queue.cc:237] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.196847 29691 tablet_bootstrap.cc:654] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.193866 29692 raft_consensus.cc:348] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.199503 29692 raft_consensus.cc:374] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.199774 29692 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.205651 29692 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.212109 29953 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260807 15:09:19.212260 29693 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:19.219587 29693 ts_tablet_manager.cc:1397] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.141s user 0.011s sys 0.005s
I20260807 15:09:19.231213 29692 ts_tablet_manager.cc:1428] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.061s user 0.006s sys 0.001s
I20260807 15:09:19.205274 29927 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.234668 29692 tablet_bootstrap.cc:492] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:19.239145 29567 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:19.242416 29905 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:19.243852 29643 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:19.244452 29693 raft_consensus.cc:348] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.245447 29693 raft_consensus.cc:374] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.245781 29693 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.246595 29693 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.247627 29880 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.240228 29927 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.249217 29880 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.256596 29925 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:19.257295 29880 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.266170 29693 ts_tablet_manager.cc:1428] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.046s user 0.010s sys 0.000s
I20260807 15:09:19.272384 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:19.274499 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.279034 29485 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:19.280557 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:19.281795 29691 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:19.282456 29691 ts_tablet_manager.cc:1397] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.110s user 0.021s sys 0.010s
I20260807 15:09:19.283317 29880 raft_consensus.cc:2781] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:19.283771 29880 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:19.284188 29880 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.289287 29692 tablet_bootstrap.cc:654] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.276027 29647 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:19.292909 29925 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:19.290432 29764 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 15:09:19.298305 29879 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.298799 29879 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.299561 29927 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.304633 29693 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:19.304210 29379 catalog_manager.cc:5495] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:19.316476 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.317111 29488 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:19.318266 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:19.318586 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.319245 29815 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:19.319628 29815 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:19.320015 29815 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:19.301128 29879 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:19.324586 29533 leader_election.cc:341] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.305958 29880 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.335692 29382 catalog_manager.cc:5495] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:19.393296 29693 tablet_bootstrap.cc:654] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.396872 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:19.398293 29999 log.cc:924] Time spent T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.063s user 0.001s sys 0.000s
I20260807 15:09:19.399484 29820 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.386284 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:19.386610 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:19.407546 29488 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:19.419169 29531 leader_election.cc:341] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.425388 29691 raft_consensus.cc:348] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.429435 29691 raft_consensus.cc:374] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.429922 29691 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.430477 29691 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.422122 29880 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.400019 29820 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.436205 30004 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.444962 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:19.440951 29820 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.428655 29531 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:19.448206 29879 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:19.438046 30004 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.453119 29692 tablet_bootstrap.cc:492] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:19.453708 29692 ts_tablet_manager.cc:1397] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.219s user 0.021s sys 0.005s
I20260807 15:09:19.462240 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:19.462990 29643 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.469547 30004 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.470605 29691 ts_tablet_manager.cc:1428] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.188s user 0.014s sys 0.011s
I20260807 15:09:19.471691 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.460712 29692 raft_consensus.cc:348] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.475669 29692 raft_consensus.cc:374] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.476094 29692 raft_consensus.cc:729] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.473291 29884 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:19.478896 29884 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.475566 29488 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:19.480957 29643 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:19.482118 29691 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:19.482450 29884 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:19.487046 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:19.488236 29692 consensus_queue.cc:260] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.472100 29815 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.504282 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.506174 29693 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:19.506652 29693 ts_tablet_manager.cc:1397] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.227s user 0.020s sys 0.000s
W20260807 15:09:19.508498 29533 leader_election.cc:341] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.490195 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:19.509377 29880 raft_consensus.cc:2781] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:19.511480 29815 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.511811 29880 raft_consensus.cc:686] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:19.511507 29569 raft_consensus.cc:1226] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:19.517421 29449 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:19.518002 29692 ts_tablet_manager.cc:1428] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.064s user 0.007s sys 0.000s
I20260807 15:09:19.518857 29921 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:19.519122 29692 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:19.527391 29880 consensus_queue.cc:237] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.534206 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:19.534842 29693 raft_consensus.cc:348] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.535652 29693 raft_consensus.cc:374] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.535943 29693 raft_consensus.cc:729] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.536556 29693 consensus_queue.cc:260] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.540308 29921 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.540719 29921 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.547314 29921 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.547711 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:19.512458 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50992us
I20260807 15:09:19.551249 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:19.549310 29450 leader_election.cc:341] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.552706 29762 consensus_queue.cc:1046] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:19.553574 29762 raft_consensus.cc:3032] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:19.553886 29762 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:19.554600 29762 consensus_queue.cc:260] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.558346 29483 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.549917 29693 ts_tablet_manager.cc:1428] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.043s user 0.007s sys 0.000s
W20260807 15:09:19.562606 29449 leader_election.cc:341] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.563321 29449 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:19.564493 29691 tablet_bootstrap.cc:654] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.564615 29693 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:19.566418 29762 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:19.569991 29905 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:19.573151 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:19.580329 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:19.570001 29953 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.582634 29692 tablet_bootstrap.cc:654] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.582582 29608 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:19.581259 29953 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.611727 29764 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.626832 29764 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.629155 29764 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:19.631386 29953 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:19.633994 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:19.634740 29642 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:19.631325 29905 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260807 15:09:19.603122 29884 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:19.645653 29531 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:19.646709 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:19.647377 29567 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:19.648523 29927 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:19.648892 29927 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:19.649210 29927 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.651192 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:19.652076 29567 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:19.654007 29608 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:19.656804 29608 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:19.655244 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.661571 30015 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 15:09:19.669790 29609 leader_election.cc:341] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.661999 30015 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:19.662213 29921 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260807 15:09:19.671836 29815 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.672309 30016 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:19.675375 29815 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.678015 29815 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.678876 30016 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:19.679244 30016 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.679539 29379 catalog_manager.cc:5495] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:19.671931 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.684697 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:19.687625 29609 leader_election.cc:341] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:19.686507 29531 leader_election.cc:341] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.695694 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:19.698475 29533 leader_election.cc:341] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.706781 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:19.708799 29815 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:19.692356 30015 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.705617 29880 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260807 15:09:19.711549 29693 tablet_bootstrap.cc:654] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.729266 29647 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:19.730072 29927 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.741285 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:19.743229 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:19.744480 29531 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:19.746377 29533 leader_election.cc:341] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.739197 29927 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.745613 29815 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 15:09:19.749353 30016 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:19.751057 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:19.752875 29880 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:19.753386 29880 raft_consensus.cc:686] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:19.754231 29880 consensus_queue.cc:237] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.765069 29692 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:19.765558 29692 ts_tablet_manager.cc:1397] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.247s user 0.012s sys 0.026s
I20260807 15:09:19.768549 29641 raft_consensus.cc:2379] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:19.770253 29820 consensus_queue.cc:1035] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:19.770706 29531 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:19.772598 29379 catalog_manager.cc:5495] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:19.773872 29927 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 15:09:19.778502 29692 raft_consensus.cc:348] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.779492 29692 raft_consensus.cc:374] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.779827 29692 raft_consensus.cc:729] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.780494 29692 consensus_queue.cc:260] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.790580 29691 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:19.790716 29692 ts_tablet_manager.cc:1428] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.025s user 0.004s sys 0.003s
I20260807 15:09:19.791177 29691 ts_tablet_manager.cc:1397] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.309s user 0.009s sys 0.014s
I20260807 15:09:19.791844 29692 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:19.794780 29691 raft_consensus.cc:348] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.795518 29691 raft_consensus.cc:374] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.795799 29691 raft_consensus.cc:729] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.800631 29691 consensus_queue.cc:260] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.804129 29691 ts_tablet_manager.cc:1428] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20260807 15:09:19.808029 29691 tablet_bootstrap.cc:492] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:19.822970 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:09:19.826397 29609 leader_election.cc:341] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:19.833792 29569 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.824011 30016 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:19.866117 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:19.866945 29567 raft_consensus.cc:2379] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 1: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:09:19.868156 29880 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:19.868690 29880 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.870710 29608 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:19.872579 30016 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 15:09:19.878842 29880 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:19.880995 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:19.882033 29485 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:19.882354 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:19.883068 29647 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:19.883576 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:19.884459 29880 raft_consensus.cc:2781] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:19.884920 29880 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:19.885353 29880 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:19.889356 29691 tablet_bootstrap.cc:654] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.900924 29820 consensus_queue.cc:1035] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:19.939112 29692 tablet_bootstrap.cc:654] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:19.955924 29691 tablet_bootstrap.cc:492] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:19.956643 29691 ts_tablet_manager.cc:1397] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.149s user 0.008s sys 0.006s
I20260807 15:09:19.888270 30015 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.974345 29691 raft_consensus.cc:348] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.975085 29691 raft_consensus.cc:374] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.975402 29691 raft_consensus.cc:729] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.976044 29691 consensus_queue.cc:260] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.983475 29693 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:19.984092 29693 ts_tablet_manager.cc:1397] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.420s user 0.028s sys 0.075s
I20260807 15:09:19.992630 29693 raft_consensus.cc:348] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.993544 29693 raft_consensus.cc:374] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:19.993816 29693 raft_consensus.cc:729] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:19.994491 29693 consensus_queue.cc:260] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.985813 29880 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:19.997414 29693 ts_tablet_manager.cc:1428] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260807 15:09:19.998628 29693 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:20.001729 30015 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:19.994750 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:20.008417 29880 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:20.010635 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:20.011524 29487 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.012665 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:20.000192 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:20.013628 29566 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.014146 29641 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.016949 29691 ts_tablet_manager.cc:1428] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.060s user 0.007s sys 0.001s
I20260807 15:09:20.018369 29691 tablet_bootstrap.cc:492] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
W20260807 15:09:20.027849 29609 leader_election.cc:341] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:20.028971 29820 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.035450 29820 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.082959 29820 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:20.090194 29566 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:20.093045 29641 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:20.052564 30002 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.095036 30002 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.096542 29487 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:20.101274 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:20.101554 29693 tablet_bootstrap.cc:654] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.084340 29927 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260807 15:09:20.105486 29880 raft_consensus.cc:2781] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:20.105990 29880 raft_consensus.cc:686] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:20.107193 29880 consensus_queue.cc:237] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.121757 29608 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:20.128763 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:20.129520 29691 tablet_bootstrap.cc:654] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.133144 29646 raft_consensus.cc:2379] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:20.102432 30002 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:20.141214 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:20.146498 29692 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:20.135519 30013 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:20.147003 29692 ts_tablet_manager.cc:1397] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.355s user 0.010s sys 0.058s
I20260807 15:09:20.136502 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:20.155320 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 54163.2us
W20260807 15:09:20.166898 29609 leader_election.cc:341] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:20.153764 30013 raft_consensus.cc:686] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:09:20.168779 29608 leader_election.cc:341] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:20.169230 29608 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:20.170835 30015 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:20.173318 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:20.174243 29566 raft_consensus.cc:2379] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:09:20.174379 29815 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:20.186195 29693 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:20.186874 29693 ts_tablet_manager.cc:1397] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.189s user 0.018s sys 0.004s
I20260807 15:09:20.182314 30013 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.179451 29692 raft_consensus.cc:348] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.201066 29692 raft_consensus.cc:374] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.202268 29692 raft_consensus.cc:729] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.205395 29484 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:20.206101 29692 consensus_queue.cc:260] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.206843 29450 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:20.209638 29905 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.212459 29692 ts_tablet_manager.cc:1428] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.062s user 0.008s sys 0.000s
I20260807 15:09:20.228922 29692 tablet_bootstrap.cc:492] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:20.241622 29646 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:20.248271 29693 raft_consensus.cc:348] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.249089 29693 raft_consensus.cc:374] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.249365 29693 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.251673 30007 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:20.250063 29693 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.243505 29382 catalog_manager.cc:5495] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:20.260066 29378 catalog_manager.cc:5495] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:20.271811 29693 ts_tablet_manager.cc:1428] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.085s user 0.007s sys 0.004s
I20260807 15:09:20.276391 29693 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:20.277410 29691 tablet_bootstrap.cc:492] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:20.277956 29691 ts_tablet_manager.cc:1397] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.260s user 0.010s sys 0.018s
I20260807 15:09:20.283458 29692 tablet_bootstrap.cc:654] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.291605 29905 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:20.279129 29484 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:20.307315 30029 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:20.319053 29691 raft_consensus.cc:348] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.319639 29691 raft_consensus.cc:374] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.319859 29691 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.323845 29691 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.325538 29693 tablet_bootstrap.cc:654] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.328524 29691 ts_tablet_manager.cc:1428] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.050s user 0.009s sys 0.004s
I20260807 15:09:20.336238 29691 tablet_bootstrap.cc:492] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:20.353478 29691 tablet_bootstrap.cc:654] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.365159 29693 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:20.365641 29693 ts_tablet_manager.cc:1397] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.090s user 0.010s sys 0.009s
I20260807 15:09:20.369596 29693 raft_consensus.cc:348] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.370486 29693 raft_consensus.cc:374] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.370812 29693 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.371536 29693 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.375134 29691 tablet_bootstrap.cc:492] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:20.375576 29691 ts_tablet_manager.cc:1397] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.008s
I20260807 15:09:20.377454 29693 ts_tablet_manager.cc:1428] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260807 15:09:20.378580 29693 tablet_bootstrap.cc:492] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:20.379315 29691 raft_consensus.cc:348] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.380229 29691 raft_consensus.cc:374] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.380491 29691 raft_consensus.cc:729] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.397572 29692 tablet_bootstrap.cc:492] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:20.398299 29692 ts_tablet_manager.cc:1397] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.173s user 0.019s sys 0.003s
I20260807 15:09:20.404474 29691 consensus_queue.cc:260] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.406162 29692 raft_consensus.cc:348] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.406978 29692 raft_consensus.cc:374] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.407296 29692 raft_consensus.cc:729] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.412194 29691 ts_tablet_manager.cc:1428] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.036s user 0.005s sys 0.009s
I20260807 15:09:20.412458 29646 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.415118 29693 tablet_bootstrap.cc:654] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.419080 29927 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.419765 29927 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.408582 29692 consensus_queue.cc:260] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.424779 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:20.425340 29692 ts_tablet_manager.cc:1428] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.027s user 0.002s sys 0.007s
I20260807 15:09:20.426666 29692 tablet_bootstrap.cc:492] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:20.427929 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:20.431062 29531 leader_election.cc:341] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:20.432708 29533 leader_election.cc:341] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:20.433091 29533 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:20.434855 29880 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:20.436136 29691 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:20.438354 29880 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.438714 29927 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:20.439101 29880 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.443825 29692 tablet_bootstrap.cc:654] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.503394 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:20.516321 29641 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:20.525262 29531 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:20.526350 30007 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:20.452607 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:20.526772 30007 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:20.527164 30007 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.499604 29880 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:20.528518 29533 leader_election.cc:341] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:20.529469 29691 tablet_bootstrap.cc:654] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.540552 29693 tablet_bootstrap.cc:492] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:20.540854 29692 tablet_bootstrap.cc:492] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:20.541050 29693 ts_tablet_manager.cc:1397] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.163s user 0.013s sys 0.028s
I20260807 15:09:20.541554 29692 ts_tablet_manager.cc:1397] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.115s user 0.011s sys 0.018s
I20260807 15:09:20.545859 29692 raft_consensus.cc:348] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.546720 29692 raft_consensus.cc:374] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.547065 29692 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.547955 29692 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.550145 29692 ts_tablet_manager.cc:1428] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20260807 15:09:20.550894 29693 raft_consensus.cc:348] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.551740 29693 raft_consensus.cc:374] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.552062 29693 raft_consensus.cc:729] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.552700 29692 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:20.557729 29927 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:20.560456 29692 tablet_bootstrap.cc:654] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.561995 29693 consensus_queue.cc:260] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.564666 29691 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:20.565155 29691 ts_tablet_manager.cc:1397] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.147s user 0.011s sys 0.020s
I20260807 15:09:20.566772 29693 ts_tablet_manager.cc:1428] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
I20260807 15:09:20.567750 29693 tablet_bootstrap.cc:492] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:20.574038 29693 tablet_bootstrap.cc:654] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.576730 29692 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:20.577188 29692 ts_tablet_manager.cc:1397] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.003s
I20260807 15:09:20.579504 29692 raft_consensus.cc:348] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.580353 29692 raft_consensus.cc:374] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.580619 29692 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.581305 29692 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.581635 30013 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:20.583636 29692 ts_tablet_manager.cc:1428] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:09:20.585192 29692 tablet_bootstrap.cc:492] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:20.588202 29880 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:20.591260 29692 tablet_bootstrap.cc:654] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.613029 29693 tablet_bootstrap.cc:492] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:20.613564 29693 ts_tablet_manager.cc:1397] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.046s user 0.016s sys 0.000s
I20260807 15:09:20.546377 30007 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.617964 29691 raft_consensus.cc:348] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.618785 29691 raft_consensus.cc:374] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.619064 29691 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.619844 29691 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.621114 30007 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:20.622296 29691 ts_tablet_manager.cc:1428] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.057s user 0.009s sys 0.000s
I20260807 15:09:20.622782 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:20.623437 29647 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.624229 29820 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.624922 29820 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.626050 29691 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:20.626399 29693 raft_consensus.cc:348] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.631209 29693 raft_consensus.cc:374] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.631542 29693 raft_consensus.cc:729] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.628041 29905 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.632596 29691 tablet_bootstrap.cc:654] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.632253 29693 consensus_queue.cc:260] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.632454 29905 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.634618 29905 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:20.629257 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:20.630081 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:20.637701 29693 ts_tablet_manager.cc:1428] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.024s user 0.004s sys 0.002s
I20260807 15:09:20.638407 29450 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:20.638839 29693 tablet_bootstrap.cc:492] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:20.639449 29925 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:20.627087 29820 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:20.647644 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:20.649221 29566 raft_consensus.cc:2379] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:09:20.649304 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:20.652432 29449 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:20.653436 29820 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.653836 30013 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.654407 30013 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.655432 29693 tablet_bootstrap.cc:654] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:20.662160 30013 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:20.664515 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:20.665269 29566 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:20.666453 29608 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:20.670050 29484 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.676743 29820 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:20.678661 30002 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:20.679404 30002 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:20.682443 29691 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:20.695530 30002 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:20.695889 29691 ts_tablet_manager.cc:1397] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.070s user 0.021s sys 0.004s
I20260807 15:09:20.696923 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:20.694743 30015 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.699223 30015 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.706045 29691 raft_consensus.cc:348] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.706508 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:09:20.709322 29609 leader_election.cc:341] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:20.710016 29762 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:20.723358 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:20.719314 30015 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:20.721952 29691 raft_consensus.cc:374] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:20.725807 29691 raft_consensus.cc:729] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:20.726867 29691 consensus_queue.cc:260] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.729982 29691 ts_tablet_manager.cc:1428] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.034s user 0.009s sys 0.000s
W20260807 15:09:20.734337 29608 leader_election.cc:341] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:20.736233 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:20.745591 29647 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
W20260807 15:09:20.844931 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 110650us
I20260807 15:09:20.828147 29487 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
W20260807 15:09:20.841245 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 92137us
I20260807 15:09:20.821623 29691 tablet_bootstrap.cc:492] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:20.851639 29692 tablet_bootstrap.cc:492] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:20.852181 29692 ts_tablet_manager.cc:1397] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.267s user 0.030s sys 0.064s
I20260807 15:09:20.855334 29533 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:20.853623 29983 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:20.852200 29483 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:20.866518 30029 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
W20260807 15:09:20.926569 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 69984.7us
W20260807 15:09:20.947167 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:20.922999 29983 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.922513 30002 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:20.945564 30029 raft_consensus.cc:686] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:20.992825 30015 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:21.113914 29692 raft_consensus.cc:348] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.115134 29692 raft_consensus.cc:374] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:21.115515 29692 raft_consensus.cc:729] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:21.088403 30013 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:21.123355 29692 consensus_queue.cc:260] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.133067 29691 tablet_bootstrap.cc:654] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:21.131597 29609 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:21.137169 29692 ts_tablet_manager.cc:1428] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.285s user 0.014s sys 0.005s
I20260807 15:09:21.089313 30015 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.146075 29762 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:21.146661 29762 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:21.147226 29762 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:21.125914 30013 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.137032 30029 consensus_queue.cc:237] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.168516 30002 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:21.186467 29693 tablet_bootstrap.cc:492] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:21.186650 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:21.187830 29693 ts_tablet_manager.cc:1397] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.549s user 0.030s sys 0.066s
W20260807 15:09:21.187881 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 65159.4us
I20260807 15:09:21.198942 29762 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.204492 29762 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:21.205159 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:21.205981 29563 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:21.186553 30015 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:21.229110 30013 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:21.195760 29570 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:21.229108 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:21.235077 29568 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:21.252537 30054 log.cc:924] Time spent T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.083s user 0.000s sys 0.001s
W20260807 15:09:21.257627 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 73036.2us
I20260807 15:09:21.259850 29693 raft_consensus.cc:348] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.265511 29692 tablet_bootstrap.cc:492] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:21.267164 29693 raft_consensus.cc:374] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:21.267882 29693 raft_consensus.cc:729] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:21.244158 29927 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:09:21.269335 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 78736.2us
I20260807 15:09:21.268729 29693 consensus_queue.cc:260] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.241286 29983 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:21.265640 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:21.278124 29927 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.239797 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:21.264911 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:21.285650 29481 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:21.285861 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:21.286716 29646 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:21.269867 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:21.307329 29450 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:21.316105 30057 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:21.316787 30057 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:21.317502 30057 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:21.307152 29482 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:21.333978 29693 ts_tablet_manager.cc:1428] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.145s user 0.015s sys 0.004s
I20260807 15:09:21.355147 29691 tablet_bootstrap.cc:492] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:21.356011 29691 ts_tablet_manager.cc:1397] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.535s user 0.013s sys 0.044s
I20260807 15:09:21.357929 29608 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:09:21.324172 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 76623.6us
I20260807 15:09:21.364337 29692 tablet_bootstrap.cc:654] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
W20260807 15:09:21.367429 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 89445.5us
I20260807 15:09:21.369248 29693 tablet_bootstrap.cc:492] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
W20260807 15:09:21.372951 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 97159.4us
I20260807 15:09:21.362512 30060 raft_consensus.cc:2781] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:21.377553 29609 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:21.379808 29762 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 15:09:21.379997 29609 leader_election.cc:341] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.380285 29762 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:21.380637 29762 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:21.380990 29609 leader_election.cc:341] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.377710 30060 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:21.384362 29927 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:21.404507 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:21.405437 29691 raft_consensus.cc:348] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.406613 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:21.406293 29691 raft_consensus.cc:374] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:21.407929 29691 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:21.408521 29691 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.392508 30060 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:21.407265 29570 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:21.415334 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:21.421294 29568 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:21.425690 29762 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:21.428258 29533 leader_election.cc:341] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.441426 30057 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.446889 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:21.448127 30057 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:21.461527 29482 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:21.463027 29609 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:09:21.463819 29608 leader_election.cc:341] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.464577 29691 ts_tablet_manager.cc:1428] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.108s user 0.006s sys 0.002s
W20260807 15:09:21.455036 30076 log.cc:924] Time spent T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.068s user 0.000s sys 0.001s
I20260807 15:09:21.465389 29608 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:21.468808 30062 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:21.467181 29762 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:21.468865 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:21.470685 29484 raft_consensus.cc:2379] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 1: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:21.468981 30015 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 15:09:21.471992 29531 leader_election.cc:341] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.475072 29691 tablet_bootstrap.cc:492] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:21.472874 29531 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:21.476994 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:21.479247 29565 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:21.479455 30075 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:21.480095 30015 raft_consensus.cc:686] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:21.480727 30062 raft_consensus.cc:686] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:21.482133 30015 consensus_queue.cc:237] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.488344 29692 tablet_bootstrap.cc:492] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:21.494091 29692 ts_tablet_manager.cc:1397] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.229s user 0.024s sys 0.018s
I20260807 15:09:21.496081 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:21.499368 29647 raft_consensus.cc:2379] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:21.501534 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:21.505839 29692 raft_consensus.cc:348] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.492532 30002 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:21.509042 29692 raft_consensus.cc:374] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:21.482844 30062 consensus_queue.cc:237] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.490818 29693 tablet_bootstrap.cc:654] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:21.509555 29692 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:21.509255 30002 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.516479 29608 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:21.518062 29762 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 15:09:21.518532 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:21.521265 29609 leader_election.cc:341] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.522676 30002 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:21.526805 29692 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.537343 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:21.549692 29692 ts_tablet_manager.cc:1428] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.055s user 0.008s sys 0.000s
I20260807 15:09:21.552194 29692 tablet_bootstrap.cc:492] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:21.551827 29564 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:21.498814 30060 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.549243 29378 catalog_manager.cc:5495] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:21.563019 29608 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:21.564963 29565 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:21.565956 30002 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:21.566403 29450 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:21.566522 30002 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:21.567157 30002 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:21.568568 30058 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:21.569223 30058 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.567620 30057 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:21.572377 30057 raft_consensus.cc:686] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:21.589574 30060 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:21.598585 30058 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:21.574204 30057 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.640679 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:21.643592 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:21.647109 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:09:21.648553 29533 leader_election.cc:341] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.646397 29691 tablet_bootstrap.cc:654] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
W20260807 15:09:21.652510 29609 leader_election.cc:341] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.660101 29693 tablet_bootstrap.cc:492] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:21.660583 29693 ts_tablet_manager.cc:1397] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.311s user 0.018s sys 0.008s
I20260807 15:09:21.656483 30002 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.664942 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:21.665946 29570 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:21.677884 30002 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:09:21.680351 29531 leader_election.cc:341] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.681178 29531 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:21.685370 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:21.690753 29693 raft_consensus.cc:348] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.691920 29693 raft_consensus.cc:374] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:21.692262 29693 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:21.692883 30055 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:21.693029 29693 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.698539 29693 ts_tablet_manager.cc:1428] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.038s user 0.006s sys 0.001s
I20260807 15:09:21.700542 29693 tablet_bootstrap.cc:492] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:21.703478 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:21.705191 29564 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:21.709760 29609 leader_election.cc:341] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.721807 29692 tablet_bootstrap.cc:654] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:21.724234 29379 catalog_manager.cc:5495] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:21.727588 29570 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:21.727404 29379 catalog_manager.cc:5495] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:21.732434 29382 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:21.738926 29693 tablet_bootstrap.cc:654] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:21.742038 29608 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:21.742868 30002 raft_consensus.cc:2781] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:21.740988 30055 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 15:09:21.743721 30002 raft_consensus.cc:686] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:21.745419 30002 consensus_queue.cc:237] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.757754 29691 tablet_bootstrap.cc:492] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:21.761374 29691 ts_tablet_manager.cc:1397] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.287s user 0.009s sys 0.016s
I20260807 15:09:21.773764 30075 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:21.783447 30068 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:21.784811 30068 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.803709 30068 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:21.804761 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:21.807570 29449 leader_election.cc:341] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.808447 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:21.813102 29564 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:21.814383 29608 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:21.816304 29450 leader_election.cc:341] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.816844 29450 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:21.818264 29820 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:21.819195 30002 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:21.819944 30002 raft_consensus.cc:686] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:21.821391 30002 consensus_queue.cc:237] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.831400 29691 raft_consensus.cc:348] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.832517 30075 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:21.846438 29691 raft_consensus.cc:374] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:21.848043 29691 raft_consensus.cc:729] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:21.848803 29691 consensus_queue.cc:260] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.865401 29692 tablet_bootstrap.cc:492] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:21.878574 29691 ts_tablet_manager.cc:1428] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.117s user 0.005s sys 0.005s
I20260807 15:09:21.880074 29691 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:21.847118 30075 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.897091 30075 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:21.904718 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:21.917057 29692 ts_tablet_manager.cc:1397] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.365s user 0.033s sys 0.070s
I20260807 15:09:21.920276 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:21.921041 29486 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:21.916442 29641 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:21.925776 29533 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:21.927354 29692 raft_consensus.cc:348] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.928181 29692 raft_consensus.cc:374] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:21.928440 29692 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:21.929001 29692 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.929258 30072 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:21.929855 30072 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:21.930320 30072 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:21.931277 29692 ts_tablet_manager.cc:1428] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260807 15:09:21.932435 30062 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:21.932770 29692 tablet_bootstrap.cc:492] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:21.940932 30060 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:21.942081 30060 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.943370 29693 tablet_bootstrap.cc:492] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:21.943826 29693 ts_tablet_manager.cc:1397] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.243s user 0.008s sys 0.020s
I20260807 15:09:21.945166 29691 tablet_bootstrap.cc:654] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:21.946695 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:21.947079 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:21.948092 29564 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:21.949193 29608 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:21.952286 30058 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:21.945802 30060 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:21.952831 30058 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.953466 30060 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:21.953922 30060 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:21.954326 30060 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:21.952363 29609 leader_election.cc:341] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.955745 29693 raft_consensus.cc:348] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.956918 29693 raft_consensus.cc:374] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:21.957346 29693 raft_consensus.cc:729] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:21.959645 29693 consensus_queue.cc:260] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:21.966611 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:21.968699 29533 leader_election.cc:341] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.981541 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:21.983031 29531 leader_election.cc:341] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:21.984253 29531 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:21.983618 30058 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:22.002534 29693 ts_tablet_manager.cc:1428] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.058s user 0.013s sys 0.000s
W20260807 15:09:22.008546 29608 consensus_peers.cc:487] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 -> Peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Couldn't send request to peer 00dd11bf8fd9487580aba733c2996a4a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:22.011868 29692 tablet_bootstrap.cc:654] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:21.985615 30075 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:22.016060 29693 tablet_bootstrap.cc:492] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:22.017540 30072 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.034970 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:22.035953 29484 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:09:22.038268 29609 consensus_peers.cc:487] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:22.034109 30072 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:22.047662 30060 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.049022 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:22.059263 29641 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:22.068468 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:22.069530 29482 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.070775 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:22.072000 29570 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.100378 29692 tablet_bootstrap.cc:492] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:22.104264 29692 ts_tablet_manager.cc:1397] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.172s user 0.013s sys 0.008s
I20260807 15:09:22.081161 30060 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:22.110191 29693 tablet_bootstrap.cc:654] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.124017 29570 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:22.127117 29608 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:22.128268 30062 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:22.129153 30062 raft_consensus.cc:686] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:09:22.132946 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:22.134631 29484 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:22.131013 30062 consensus_queue.cc:237] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.139031 30013 consensus_queue.cc:1035] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:22.150363 30065 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:22.155690 30065 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.156440 30065 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.159603 29691 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:22.160197 29691 ts_tablet_manager.cc:1397] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.280s user 0.020s sys 0.023s
I20260807 15:09:22.161559 29482 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:22.151225 29692 raft_consensus.cc:348] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.164489 29692 raft_consensus.cc:374] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.164759 29692 raft_consensus.cc:729] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.169474 29641 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:22.171725 29533 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:22.188445 29692 consensus_queue.cc:260] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.194932 29692 ts_tablet_manager.cc:1428] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.089s user 0.002s sys 0.010s
I20260807 15:09:22.181350 30072 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:22.196406 29692 tablet_bootstrap.cc:492] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:22.196197 30072 raft_consensus.cc:686] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:22.196502 30065 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:22.223677 29691 raft_consensus.cc:348] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.225056 29691 raft_consensus.cc:374] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.225412 29691 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
W20260807 15:09:22.245087 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 45328.3us
I20260807 15:09:22.226274 29691 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.249642 29691 ts_tablet_manager.cc:1428] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.089s user 0.010s sys 0.003s
I20260807 15:09:22.213616 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:22.257855 29486 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.262274 29566 raft_consensus.cc:2379] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:22.267249 29379 catalog_manager.cc:5495] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:22.272718 29379 catalog_manager.cc:5495] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:22.276188 29691 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:22.289927 30105 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260807 15:09:22.301900 30062 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260807 15:09:22.304229 29692 tablet_bootstrap.cc:654] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.272426 30072 consensus_queue.cc:237] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.305660 29693 tablet_bootstrap.cc:492] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:22.322333 29693 ts_tablet_manager.cc:1397] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.307s user 0.029s sys 0.014s
I20260807 15:09:22.286980 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:22.277443 29379 catalog_manager.cc:5495] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:22.327255 29693 raft_consensus.cc:348] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.332096 29693 raft_consensus.cc:374] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.332572 29693 raft_consensus.cc:729] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.333422 29693 consensus_queue.cc:260] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.335675 29693 ts_tablet_manager.cc:1428] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.013s user 0.006s sys 0.002s
I20260807 15:09:22.336721 29449 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:22.353462 29693 tablet_bootstrap.cc:492] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
W20260807 15:09:22.355602 29609 consensus_peers.cc:487] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:22.362922 29692 tablet_bootstrap.cc:492] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:22.371271 29692 ts_tablet_manager.cc:1397] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.175s user 0.002s sys 0.022s
I20260807 15:09:22.386230 29692 raft_consensus.cc:348] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.386970 29692 raft_consensus.cc:374] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.391045 29692 raft_consensus.cc:729] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.391680 29692 consensus_queue.cc:260] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.393476 29692 ts_tablet_manager.cc:1428] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260807 15:09:22.394640 29692 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:22.395603 30007 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.396446 30007 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.400844 30007 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:22.401607 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:22.409090 29691 tablet_bootstrap.cc:654] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.418630 30065 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:22.422613 30074 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:22.433564 29378 catalog_manager.cc:5495] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 2, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:22.460460 30074 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:22.423727 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:22.474120 29531 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:22.481227 29693 tablet_bootstrap.cc:654] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.478585 30075 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:22.489825 29564 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.533272 29692 tablet_bootstrap.cc:654] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.547241 29691 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:22.547734 29691 ts_tablet_manager.cc:1397] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.277s user 0.018s sys 0.018s
I20260807 15:09:22.554361 29691 raft_consensus.cc:348] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.565507 29691 raft_consensus.cc:374] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.565868 29691 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.600919 29691 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.603148 29693 tablet_bootstrap.cc:492] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:22.603826 29693 ts_tablet_manager.cc:1397] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.253s user 0.021s sys 0.034s
I20260807 15:09:22.570921 30065 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.604856 30065 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.607141 30065 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:22.612452 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 55417.8us
I20260807 15:09:22.621376 29693 raft_consensus.cc:348] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.622283 29693 raft_consensus.cc:374] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.623840 29693 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.624634 29693 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:22.625617 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 63824.1us
I20260807 15:09:22.626992 29693 ts_tablet_manager.cc:1428] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260807 15:09:22.625671 29691 ts_tablet_manager.cc:1428] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.077s user 0.024s sys 0.024s
I20260807 15:09:22.625681 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:22.630017 29570 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:22.632697 29450 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:22.633895 29820 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:22.637511 29820 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:22.641062 29820 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.630187 29691 tablet_bootstrap.cc:492] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:22.651439 29820 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.655284 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:22.656016 29569 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.654016 29820 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:22.664142 29693 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:22.673820 29569 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:22.671136 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:22.672344 30118 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:22.676314 29450 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:22.678848 30065 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:22.679430 30065 raft_consensus.cc:686] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:22.681200 29692 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:22.682243 29692 ts_tablet_manager.cc:1397] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.288s user 0.009s sys 0.020s
I20260807 15:09:22.682067 30065 consensus_queue.cc:237] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.681638 29691 tablet_bootstrap.cc:654] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.688854 29693 tablet_bootstrap.cc:654] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.693310 29692 raft_consensus.cc:348] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.697202 29692 raft_consensus.cc:374] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.697280 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:22.697717 29692 raft_consensus.cc:729] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.698616 29692 consensus_queue.cc:260] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.703756 29692 ts_tablet_manager.cc:1428] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.021s user 0.001s sys 0.005s
I20260807 15:09:22.705760 29691 tablet_bootstrap.cc:492] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:22.706247 29691 ts_tablet_manager.cc:1397] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.076s user 0.010s sys 0.000s
I20260807 15:09:22.708665 29691 raft_consensus.cc:348] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:22.709527 29449 leader_election.cc:341] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.710273 29691 raft_consensus.cc:374] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.710526 29691 raft_consensus.cc:729] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
W20260807 15:09:22.711364 29449 leader_election.cc:341] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.711187 29691 consensus_queue.cc:260] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.714468 29693 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:22.714908 29693 ts_tablet_manager.cc:1397] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.000s
I20260807 15:09:22.710036 29692 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:22.721464 29691 ts_tablet_manager.cc:1428] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260807 15:09:22.722955 29693 raft_consensus.cc:348] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.723716 29693 raft_consensus.cc:374] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.724013 29693 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.724184 30015 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.724695 30015 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.725328 29691 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:22.726866 30015 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:22.728641 29693 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.732477 29693 ts_tablet_manager.cc:1428] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260807 15:09:22.733639 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:22.738526 29609 leader_election.cc:341] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.740967 30118 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:22.744637 29693 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:22.747237 29692 tablet_bootstrap.cc:654] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.750639 29691 tablet_bootstrap.cc:654] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.759478 29646 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 15:09:22.767400 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:22.767809 29693 tablet_bootstrap.cc:654] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.773404 29378 catalog_manager.cc:5495] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:22.782950 30118 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.769791 30058 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260807 15:09:22.786871 30118 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.789278 30118 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:22.792672 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:22.793411 29483 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:22.795383 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:22.796854 29568 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:22.799670 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:09:22.801240 29608 leader_election.cc:341] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.806501 29608 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:22.812255 30118 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:22.812727 30118 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:22.813164 30118 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.813314 29692 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:22.813865 29692 ts_tablet_manager.cc:1397] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.104s user 0.032s sys 0.033s
I20260807 15:09:22.816193 29692 raft_consensus.cc:348] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.816709 29692 raft_consensus.cc:374] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.816965 29692 raft_consensus.cc:729] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.801786 30002 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:22.820117 30002 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:22.820607 30002 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.827389 29692 consensus_queue.cc:260] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.830500 29692 ts_tablet_manager.cc:1428] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.016s user 0.010s sys 0.002s
I20260807 15:09:22.831542 29692 tablet_bootstrap.cc:492] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:22.834091 30118 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.836198 30058 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.837091 29692 tablet_bootstrap.cc:654] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.836745 30058 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.838907 30058 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:22.839680 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:22.840873 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:22.841615 29568 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.841974 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:22.842489 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:22.843694 29533 leader_election.cc:341] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:22.849469 29531 leader_election.cc:341] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.849790 29691 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:22.854902 29693 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:22.849958 29531 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:22.841640 29609 leader_election.cc:341] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.852964 29691 ts_tablet_manager.cc:1397] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.128s user 0.011s sys 0.010s
I20260807 15:09:22.856139 30072 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:22.854074 30002 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.858942 29693 ts_tablet_manager.cc:1397] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.114s user 0.015s sys 0.000s
I20260807 15:09:22.859349 29692 tablet_bootstrap.cc:492] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:22.859855 29692 ts_tablet_manager.cc:1397] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.009s
I20260807 15:09:22.850670 30118 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:22.862517 29693 raft_consensus.cc:348] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.863404 29693 raft_consensus.cc:374] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.863845 29693 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.863365 29692 raft_consensus.cc:348] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.864360 29692 raft_consensus.cc:374] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.864728 29692 raft_consensus.cc:729] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.864563 29693 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.865610 29692 consensus_queue.cc:260] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.867111 29693 ts_tablet_manager.cc:1428] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 15:09:22.863484 29568 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:22.870011 29608 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:22.870482 29693 tablet_bootstrap.cc:492] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:22.874887 29691 raft_consensus.cc:348] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.879174 30015 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:22.881641 30015 raft_consensus.cc:686] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:22.879751 30002 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:22.883153 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:22.883713 29486 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 15:09:22.883850 29691 raft_consensus.cc:374] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.884215 29691 raft_consensus.cc:729] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.881021 29692 ts_tablet_manager.cc:1428] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20260807 15:09:22.883157 30015 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.884934 29691 consensus_queue.cc:260] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.886955 30072 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:22.887746 29691 ts_tablet_manager.cc:1428] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260807 15:09:22.889007 29691 tablet_bootstrap.cc:492] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
W20260807 15:09:22.889823 29608 leader_election.cc:341] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.895558 29691 tablet_bootstrap.cc:654] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.896935 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:22.899215 29692 tablet_bootstrap.cc:492] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:22.903744 30002 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.904516 30002 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.909698 29692 tablet_bootstrap.cc:654] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.912097 29486 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.911929 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:22.913854 29609 leader_election.cc:341] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.919453 29486 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:22.920463 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:22.919225 30002 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:22.921213 29568 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:22.922479 29608 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:22.924132 30118 raft_consensus.cc:2781] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:22.924497 30118 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:22.924825 30118 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.926509 29692 tablet_bootstrap.cc:492] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:22.927011 30065 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.928417 29693 tablet_bootstrap.cc:654] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:22.927489 30065 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.930348 30065 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:22.931924 29691 tablet_bootstrap.cc:492] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:22.931506 30118 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.933036 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:22.933910 29691 ts_tablet_manager.cc:1397] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.045s user 0.011s sys 0.001s
I20260807 15:09:22.935104 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:22.935199 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:22.935935 29570 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.936337 29691 raft_consensus.cc:348] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.936805 29449 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:22.937156 29691 raft_consensus.cc:374] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.937534 29691 raft_consensus.cc:729] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.938150 30065 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:22.938328 29691 consensus_queue.cc:260] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.926999 29692 ts_tablet_manager.cc:1397] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.004s
I20260807 15:09:22.940632 29691 ts_tablet_manager.cc:1428] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 15:09:22.940937 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:22.941725 29691 tablet_bootstrap.cc:492] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:22.942003 30013 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:22.942515 30013 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:22.943289 30013 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.944227 29692 raft_consensus.cc:348] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.945212 29482 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:22.952306 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:22.952733 29570 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
W20260807 15:09:22.953660 29609 leader_election.cc:341] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:22.954350 29608 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:22.955132 30118 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:22.956698 30118 raft_consensus.cc:2781] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:22.957100 29692 raft_consensus.cc:374] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:22.957706 29692 raft_consensus.cc:729] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:22.959372 30118 raft_consensus.cc:686] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:22.958933 29692 consensus_queue.cc:260] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.960278 30118 consensus_queue.cc:237] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:22.964560 29692 ts_tablet_manager.cc:1428] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.024s user 0.006s sys 0.001s
I20260807 15:09:22.972654 30013 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:22.973285 30013 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.012936 29692 tablet_bootstrap.cc:492] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:23.023552 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:23.025923 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:23.026101 29486 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:23.026607 29568 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:23.027246 29609 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:23.036851 30062 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:23.038125 30062 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:23.039088 30062 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.044571 29692 tablet_bootstrap.cc:654] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:23.047509 30013 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:23.024771 29691 tablet_bootstrap.cc:654] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:23.067835 29693 tablet_bootstrap.cc:492] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:23.063872 29379 catalog_manager.cc:5495] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:23.068629 29693 ts_tablet_manager.cc:1397] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.199s user 0.020s sys 0.019s
I20260807 15:09:23.091472 30015 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.093413 29693 raft_consensus.cc:348] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.093644 30015 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.095446 29693 raft_consensus.cc:374] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:23.096101 29693 raft_consensus.cc:729] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:23.095592 30106 consensus_queue.cc:1035] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:23.098040 29693 consensus_queue.cc:260] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.103576 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:23.112464 29692 tablet_bootstrap.cc:492] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:23.112990 29692 ts_tablet_manager.cc:1397] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.100s user 0.007s sys 0.020s
I20260807 15:09:23.116390 29379 catalog_manager.cc:5495] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:23.118856 29692 raft_consensus.cc:348] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.119578 29692 raft_consensus.cc:374] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:23.119839 29692 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:23.122023 29693 ts_tablet_manager.cc:1428] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.053s user 0.008s sys 0.000s
I20260807 15:09:23.131687 30065 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.132076 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:23.132478 30065 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.134868 29608 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:23.135807 30060 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:23.137568 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:23.139631 29449 leader_election.cc:341] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:23.140614 29646 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.139647 30065 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:23.146144 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:23.147823 29566 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:23.150627 29450 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:23.149765 29692 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.118616 29379 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:23.151906 30065 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:23.152370 30065 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:23.152918 30065 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.158524 29693 tablet_bootstrap.cc:492] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:23.162581 29692 ts_tablet_manager.cc:1428] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.049s user 0.006s sys 0.003s
I20260807 15:09:23.130806 30015 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:23.164733 30106 consensus_queue.cc:1035] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:23.166983 29692 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:23.171006 30065 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.212960 29820 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.213492 29820 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.238651 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:23.245309 29568 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:23.258574 29691 tablet_bootstrap.cc:492] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:23.259158 29691 ts_tablet_manager.cc:1397] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.318s user 0.016s sys 0.014s
W20260807 15:09:23.259313 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 48602.7us
I20260807 15:09:23.179443 30062 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:23.266975 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:23.263226 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:23.268015 29568 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.268489 30062 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:23.268707 29692 tablet_bootstrap.cc:654] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:23.277416 30065 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:23.278390 29820 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:23.281030 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:23.282042 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:23.285735 29449 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:23.291584 30075 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.292177 30075 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.294194 30075 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:23.295985 30055 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.296433 30055 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.298846 30055 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:23.299834 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:23.309675 29820 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.322285 29820 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:23.328339 29691 raft_consensus.cc:348] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.334789 29691 raft_consensus.cc:374] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:23.335246 29691 raft_consensus.cc:729] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:23.337735 29691 consensus_queue.cc:260] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.337018 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:23.341135 29568 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:23.341895 29570 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.348248 29691 ts_tablet_manager.cc:1428] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.089s user 0.007s sys 0.002s
I20260807 15:09:23.350970 29450 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:09:23.354765 29449 leader_election.cc:341] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:23.360010 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 62021.6us
I20260807 15:09:23.348210 30062 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.368604 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:23.370740 29531 leader_election.cc:341] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:23.372494 29531 leader_election.cc:341] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:23.381021 29693 tablet_bootstrap.cc:654] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:23.383817 29691 tablet_bootstrap.cc:492] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:23.385324 29692 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:23.385854 29692 ts_tablet_manager.cc:1397] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.219s user 0.026s sys 0.030s
I20260807 15:09:23.389735 29692 raft_consensus.cc:348] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.390563 29692 raft_consensus.cc:374] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:23.390863 29692 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:23.391548 29692 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.374372 30145 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:23.396191 30074 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:23.371762 30062 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.399305 30062 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:23.399547 29692 ts_tablet_manager.cc:1428] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20260807 15:09:23.400795 29692 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
I20260807 15:09:23.409776 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:23.410781 29566 raft_consensus.cc:2379] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 1: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:23.399873 29570 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:23.423763 29608 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:23.427132 30015 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 15:09:23.461409 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 58642us
I20260807 15:09:23.461637 30145 raft_consensus.cc:686] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:23.462728 30145 consensus_queue.cc:237] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.464289 30075 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.445561 30015 raft_consensus.cc:686] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:23.464851 30075 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.490578 30015 consensus_queue.cc:237] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.482996 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:23.504532 30075 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:23.505898 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:23.506964 29486 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.509313 29692 tablet_bootstrap.cc:654] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:23.511574 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:23.519253 29693 tablet_bootstrap.cc:492] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:23.519773 29693 ts_tablet_manager.cc:1397] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.361s user 0.019s sys 0.003s
I20260807 15:09:23.520586 30074 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 15:09:23.526875 29693 raft_consensus.cc:348] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.527733 29693 raft_consensus.cc:374] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:23.528090 29693 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:23.528741 29693 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.532277 29693 ts_tablet_manager.cc:1428] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260807 15:09:23.538070 29691 tablet_bootstrap.cc:654] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:23.550467 29693 tablet_bootstrap.cc:492] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:23.556108 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:23.575423 29486 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:23.561385 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:23.580885 29569 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.597373 30118 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:23.617319 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:23.653053 29481 raft_consensus.cc:2379] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
W20260807 15:09:23.680142 30164 log.cc:924] Time spent T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.067s user 0.000s sys 0.002s
W20260807 15:09:23.723801 30163 log.cc:924] Time spent T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
I20260807 15:09:23.729127 29379 catalog_manager.cc:5495] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:23.743598 29691 tablet_bootstrap.cc:492] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:23.744181 29691 ts_tablet_manager.cc:1397] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.371s user 0.018s sys 0.017s
I20260807 15:09:23.746764 30150 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.750504 29692 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:23.750957 30150 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.751647 29692 ts_tablet_manager.cc:1397] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.351s user 0.015s sys 0.011s
I20260807 15:09:23.759526 29693 tablet_bootstrap.cc:654] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:23.762601 29609 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:23.768879 29692 raft_consensus.cc:348] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.770898 29692 raft_consensus.cc:374] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:23.771289 29692 raft_consensus.cc:729] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:23.787619 30150 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:23.792735 29691 raft_consensus.cc:348] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.793569 29691 raft_consensus.cc:374] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:23.793850 29691 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:23.794448 29691 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.773902 30074 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
W20260807 15:09:23.801249 29533 leader_election.cc:341] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:23.801949 29533 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:23.803192 29533 leader_election.cc:341] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:23.803442 30075 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:23.803568 29533 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:23.805682 30055 raft_consensus.cc:2726] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:23.806191 29533 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:23.807189 30058 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:23.768266 30155 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.772089 29692 consensus_queue.cc:260] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.815933 29691 ts_tablet_manager.cc:1428] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.071s user 0.007s sys 0.001s
W20260807 15:09:23.816315 30166 log.cc:924] Time spent T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260807 15:09:23.817128 30074 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:23.826433 29691 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:23.829872 29692 ts_tablet_manager.cc:1428] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.078s user 0.005s sys 0.002s
I20260807 15:09:23.832247 30013 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:23.833066 30013 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:23.842458 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:23.849473 29692 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a: Bootstrap starting.
W20260807 15:09:23.850937 29609 consensus_peers.cc:487] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 15:09:23.852397 29531 leader_election.cc:341] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:23.886760 30013 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:23.891287 29691 tablet_bootstrap.cc:654] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:23.893509 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:23.894311 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:23.902535 29488 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:23.904297 29533 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:23.905395 29564 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:23.905825 30055 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:23.906631 30055 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:23.907177 29608 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:23.907294 30055 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:23.916134 30118 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 15:09:23.924652 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 52910.5us
I20260807 15:09:23.924707 30118 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:23.953656 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:23.958649 29693 tablet_bootstrap.cc:492] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:23.959295 29693 ts_tablet_manager.cc:1397] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.426s user 0.031s sys 0.031s
W20260807 15:09:23.961026 29609 leader_election.cc:341] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:23.940841 30118 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:24.034098 29693 raft_consensus.cc:348] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.035207 29693 raft_consensus.cc:374] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:24.035514 29693 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:24.036180 29693 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.042004 30013 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:24.015699 30155 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:24.019563 30055 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:24.064126 30170 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.064s user 0.001s sys 0.000s
I20260807 15:09:24.076151 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:24.069470 30055 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:24.094501 29692 tablet_bootstrap.cc:654] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:24.095319 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:24.096679 29481 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:24.105916 29691 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:24.106626 29691 ts_tablet_manager.cc:1397] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.287s user 0.020s sys 0.036s
I20260807 15:09:24.110679 29693 ts_tablet_manager.cc:1428] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.151s user 0.009s sys 0.005s
W20260807 15:09:24.127797 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 45954.2us
I20260807 15:09:24.104799 30074 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260807 15:09:24.100841 30118 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.167171 29691 raft_consensus.cc:348] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.171392 29691 raft_consensus.cc:374] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:24.171620 29691 raft_consensus.cc:729] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:24.172967 29691 consensus_queue.cc:260] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.190176 30148 consensus_queue.cc:1035] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:24.197417 29693 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:24.207348 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:24.208146 29565 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:24.206292 30118 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:24.226418 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:24.227624 29482 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:09:24.229422 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 92584.3us
W20260807 15:09:24.231595 29531 leader_election.cc:341] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:24.261075 29691 ts_tablet_manager.cc:1428] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.154s user 0.008s sys 0.002s
I20260807 15:09:24.263355 30150 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:24.272315 30150 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.256487 30184 consensus_queue.cc:1035] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
W20260807 15:09:24.333248 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 94123.9us
I20260807 15:09:24.346334 29691 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:24.345247 30060 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:24.352373 30060 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.353402 29481 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:24.360095 29533 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:24.377523 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:24.376044 30072 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
W20260807 15:09:24.467319 30183 log.cc:924] Time spent T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.135s user 0.000s sys 0.001s
I20260807 15:09:24.479180 29382 catalog_manager.cc:5495] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } }
W20260807 15:09:24.512630 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:24.390015 30060 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:24.387825 29565 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
W20260807 15:09:24.541647 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 169528us
I20260807 15:09:24.458415 30150 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:24.554919 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:24.598011 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:24.606984 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:24.632062 29692 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a: No bootstrap required, opened a new log
I20260807 15:09:24.632949 29692 ts_tablet_manager.cc:1397] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a: Time spent bootstrapping tablet: real 0.784s user 0.014s sys 0.042s
I20260807 15:09:24.670797 29691 tablet_bootstrap.cc:654] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
W20260807 15:09:24.671175 30187 log.cc:924] Time spent T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.144s user 0.001s sys 0.000s
I20260807 15:09:24.671561 29482 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
W20260807 15:09:24.715241 29609 leader_election.cc:341] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:24.717357 29693 tablet_bootstrap.cc:654] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:24.719149 29609 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:24.714457 30072 raft_consensus.cc:686] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
W20260807 15:09:24.734865 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 92318us
I20260807 15:09:24.731594 30118 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:24.765467 29692 raft_consensus.cc:348] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.766736 29692 raft_consensus.cc:374] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:24.766955 29692 raft_consensus.cc:729] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Initialized, Role: FOLLOWER
I20260807 15:09:24.754030 30118 raft_consensus.cc:686] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:24.772100 29692 consensus_queue.cc:260] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.777532 29692 ts_tablet_manager.cc:1428] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a: Time spent starting tablet: real 0.144s user 0.005s sys 0.001s
I20260807 15:09:24.766513 30072 consensus_queue.cc:237] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:24.811283 29533 leader_election.cc:341] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:24.814374 29608 leader_election.cc:341] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:24.814831 29608 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:24.826135 30182 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:24.817344 30118 consensus_queue.cc:237] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.882594 30150 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:24.883422 30150 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:24.887359 30150 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:24.892457 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:24.912791 29533 leader_election.cc:341] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:24.933669 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 120040us
W20260807 15:09:24.957635 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 268119us
I20260807 15:09:25.018002 29693 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:25.018647 29693 ts_tablet_manager.cc:1397] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.822s user 0.024s sys 0.031s
W20260807 15:09:25.041050 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 83674.5us
I20260807 15:09:25.060308 29382 catalog_manager.cc:5495] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:25.089818 29691 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:25.090358 29691 ts_tablet_manager.cc:1397] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.759s user 0.013s sys 0.032s
W20260807 15:09:25.094336 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 358360us
I20260807 15:09:25.096077 29693 raft_consensus.cc:348] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.107609 29693 raft_consensus.cc:374] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 15:09:25.104457 29531 leader_election.cc:341] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:25.109241 29531 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:25.112066 30072 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:25.117486 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:25.118158 29647 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 0.
I20260807 15:09:25.119364 29693 raft_consensus.cc:729] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:25.120718 29693 consensus_queue.cc:260] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.124233 29693 ts_tablet_manager.cc:1428] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.105s user 0.008s sys 0.004s
I20260807 15:09:25.125579 29693 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:25.125591 29382 catalog_manager.cc:5495] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:25.141235 29691 raft_consensus.cc:348] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.144650 29691 raft_consensus.cc:374] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:25.145030 29691 raft_consensus.cc:729] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:25.149696 29691 consensus_queue.cc:260] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.157373 29691 ts_tablet_manager.cc:1428] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.062s user 0.004s sys 0.005s
I20260807 15:09:25.163029 29691 tablet_bootstrap.cc:492] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:25.169049 29531 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:25.170680 30202 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:25.171397 30202 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:25.171994 30202 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.191987 29693 tablet_bootstrap.cc:654] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:25.214475 29691 tablet_bootstrap.cc:654] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:25.221797 29693 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:25.222451 29693 ts_tablet_manager.cc:1397] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.097s user 0.017s sys 0.008s
I20260807 15:09:25.226610 29693 raft_consensus.cc:348] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.227581 29693 raft_consensus.cc:374] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:25.226908 30202 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.228005 29693 raft_consensus.cc:729] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:25.229331 29693 consensus_queue.cc:260] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.241374 30202 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:25.243309 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:25.244451 29640 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.255551 29693 ts_tablet_manager.cc:1428] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.033s user 0.000s sys 0.011s
I20260807 15:09:25.256824 29693 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:25.271939 29691 tablet_bootstrap.cc:492] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:25.272516 29691 ts_tablet_manager.cc:1397] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.110s user 0.009s sys 0.009s
I20260807 15:09:25.279495 29479 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.298868 29691 raft_consensus.cc:348] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.299711 29691 raft_consensus.cc:374] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:25.300057 29691 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:25.300793 29691 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:25.305546 29609 consensus_peers.cc:487] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 -> Peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Couldn't send request to peer 9bbe5c211ab64989a57350f34f007ced. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260807 15:09:25.316013 29640 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:25.316372 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:09:25.319164 29533 leader_election.cc:341] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:25.320719 29531 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:25.322211 30072 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:25.323086 30072 raft_consensus.cc:686] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:25.323700 29691 ts_tablet_manager.cc:1428] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.051s user 0.009s sys 0.000s
I20260807 15:09:25.332842 29691 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Bootstrap starting.
I20260807 15:09:25.334514 29693 tablet_bootstrap.cc:654] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:25.326022 30072 consensus_queue.cc:237] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:25.358098 29531 consensus_peers.cc:487] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a -> Peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Couldn't send request to peer 4b092f7f951b4137b5d7810056684270. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:25.368057 30060 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 15:09:25.398761 29378 catalog_manager.cc:5495] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:25.415314 29693 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:25.415951 29693 ts_tablet_manager.cc:1397] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.159s user 0.015s sys 0.011s
I20260807 15:09:25.423414 29693 raft_consensus.cc:348] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.424273 29693 raft_consensus.cc:374] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:25.424645 29693 raft_consensus.cc:729] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:25.425495 29693 consensus_queue.cc:260] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.438472 29693 ts_tablet_manager.cc:1428] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.022s user 0.006s sys 0.002s
I20260807 15:09:25.439658 29693 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:25.440882 30197 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:25.441751 30197 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.447587 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:25.448632 29563 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 0.
I20260807 15:09:25.450271 29450 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:25.451486 30207 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:25.452239 30207 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:25.452764 30207 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.454171 29691 tablet_bootstrap.cc:654] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:25.458132 30060 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:25.460000 30201 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:25.461355 30201 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.467334 30201 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:25.467546 29693 tablet_bootstrap.cc:654] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:25.479663 30197 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:25.489385 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:25.514029 29449 leader_election.cc:341] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:25.515134 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:25.512631 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:25.544340 30197 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:25.547294 30200 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:25.564368 30200 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.566442 30200 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:25.568025 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:25.568773 29563 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 0.
I20260807 15:09:25.569190 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:25.569989 29608 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:09:25.579103 29609 leader_election.cc:341] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:25.580526 29609 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:25.582319 30178 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:25.586771 30200 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:09:25.607402 30200 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:25.607810 30200 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.598969 30185 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260807 15:09:25.618559 30207 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.577003 30197 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.623334 30197 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:25.647262 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:25.649917 30207 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:25.668666 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:25.669697 29566 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.670943 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:25.673782 29642 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:09:25.672189 29432 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 15:09:25.681726 29449 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:25.675225 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:25.690712 30152 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.724694 30200 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.737807 29691 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: No bootstrap required, opened a new log
I20260807 15:09:25.738409 29691 ts_tablet_manager.cc:1397] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Time spent bootstrapping tablet: real 0.406s user 0.055s sys 0.068s
I20260807 15:09:25.742364 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:09:25.757066 29609 leader_election.cc:341] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): Illegal state: must be running to vote when last-logged opid is not known
W20260807 15:09:25.763249 29449 leader_election.cc:341] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260807 15:09:25.772809 29566 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:25.774534 29693 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:25.775054 29693 ts_tablet_manager.cc:1397] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.336s user 0.015s sys 0.021s
I20260807 15:09:25.779538 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:25.780339 29570 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.791775 29570 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:25.770386 29640 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.781893 30200 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:25.829603 29450 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:25.855059 30213 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:25.873430 30213 raft_consensus.cc:686] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:25.896961 30213 consensus_queue.cc:237] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.904520 30152 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:25.910791 29693 raft_consensus.cc:348] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.911499 29693 raft_consensus.cc:374] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:25.911757 29693 raft_consensus.cc:729] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:25.913604 29693 consensus_queue.cc:260] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.925683 29691 raft_consensus.cc:348] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.926823 29691 raft_consensus.cc:374] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:25.927204 29691 raft_consensus.cc:729] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Initialized, Role: FOLLOWER
I20260807 15:09:25.933688 29691 consensus_queue.cc:260] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:25.946410 29693 ts_tablet_manager.cc:1428] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.171s user 0.009s sys 0.003s
I20260807 15:09:25.953155 29691 ts_tablet_manager.cc:1428] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Time spent starting tablet: real 0.214s user 0.008s sys 0.007s
I20260807 15:09:25.972563 29693 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: Bootstrap starting.
I20260807 15:09:25.983868 29479 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:25.991025 29693 tablet_bootstrap.cc:654] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: Neither blocks nor log segments found. Creating new log.
I20260807 15:09:26.006110 29608 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:26.007035 30245 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:09:26.007563 30245 raft_consensus.cc:686] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:26.009877 30245 consensus_queue.cc:237] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:26.014442 30216 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:26.034669 29693 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: No bootstrap required, opened a new log
I20260807 15:09:26.035398 29693 ts_tablet_manager.cc:1397] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: Time spent bootstrapping tablet: real 0.063s user 0.016s sys 0.011s
I20260807 15:09:26.042527 29693 raft_consensus.cc:348] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:26.043557 29693 raft_consensus.cc:374] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:09:26.043954 29693 raft_consensus.cc:729] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Initialized, Role: FOLLOWER
I20260807 15:09:26.047001 29693 consensus_queue.cc:260] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:26.047791 30204 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:26.050436 29693 ts_tablet_manager.cc:1428] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260807 15:09:26.105515 29378 catalog_manager.cc:5495] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:26.148428 29379 catalog_manager.cc:5495] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:26.216665 30178 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:26.217131 30178 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:26.219913 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:26.219947 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:26.221046 29569 raft_consensus.cc:2379] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 1: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:26.218859 30178 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:26.222151 29608 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:26.223245 30245 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:26.232291 30245 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:26.327759 30196 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:26.328305 30196 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:26.331240 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:26.331553 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:26.332244 29569 raft_consensus.cc:2379] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 1: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:26.333182 29450 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:26.334306 30239 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:09:26.342012 30191 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 15:09:26.342988 30239 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:09:26.333204 30196 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:26.361685 30239 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:26.551978 30074 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:26.571043 30245 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:09:27.566254 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:09:27.574218 30262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:27.598554 30265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:09:27.598578 30263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:09:27.599105 28227 server_base.cc:1034] running on GCE node
I20260807 15:09:27.600632 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 15:09:27.600934 28227 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 15:09:27.601117 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786115367601105 us; error 0 us; skew 500 ppm
I20260807 15:09:27.601799 28227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 15:09:27.615130 28227 webserver.cc:460] Webserver started at http://127.27.144.196:46665/ using document root <none> and password file <none>
I20260807 15:09:27.615840 28227 fs_manager.cc:359] Metadata directory not provided
I20260807 15:09:27.616236 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:09:27.616693 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:09:27.618508 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-3-root/instance:
uuid: "fbf78964d70448269802ac7de9d7a198"
format_stamp: "Formatted at 2026-08-07 15:09:27 on dist-test-slave-27sr"
I20260807 15:09:27.625221 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260807 15:09:27.629629 30270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:27.630470 28227 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 15:09:27.630772 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-3-root
uuid: "fbf78964d70448269802ac7de9d7a198"
format_stamp: "Formatted at 2026-08-07 15:09:27 on dist-test-slave-27sr"
I20260807 15:09:27.631071 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:09:27.646878 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:09:27.648633 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:09:27.650481 28227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:09:27.653124 28227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:09:27.653362 28227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:27.653641 28227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:09:27.653821 28227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:09:27.746356 28227 rpc_server.cc:307] RPC server started. Bound to: 127.27.144.196:43545
I20260807 15:09:27.746508 30341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.144.196:43545 every 8 connection(s)
I20260807 15:09:27.781527 28227 auto_leader_rebalancer-test.cc:413] add a tserver: fbf78964d70448269802ac7de9d7a198
I20260807 15:09:27.799369 30342 heartbeater.cc:347] Connected to a master server at 127.27.144.254:38573
I20260807 15:09:27.800005 30342 heartbeater.cc:464] Registering TS with master...
I20260807 15:09:27.800875 30342 heartbeater.cc:511] Master 127.27.144.254:38573 requested a full tablet report, sending...
I20260807 15:09:27.804103 29378 ts_manager.cc:194] Registered new tserver with Master: fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:27.806263 29378 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59990
I20260807 15:09:28.810205 30342 heartbeater.cc:503] Master 127.27.144.254:38573 was elected leader, sending a full tablet report...
I20260807 15:09:28.913518 29564 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:28.926544 29641 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:28.928329 30236 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:28.932814 29479 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:28.945071 30236 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 15:09:28.948140 29533 consensus_peers.cc:487] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8cd23e547af4b6eb4c91c08c1ce7d9a. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:28.950245 30185 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:28.951987 29641 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:28.967531 29479 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:28.970804 29378 catalog_manager.cc:5495] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.046329 29641 consensus_queue.cc:237] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.061394 29565 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:29.064083 30346 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:29.065462 29479 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:29.073206 30346 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 15:09:29.086410 29609 consensus_peers.cc:487] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41559fba51e74c12a634f00bc225cd7b. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:29.088198 30346 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.090305 29483 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.093915 29565 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.125299 29379 catalog_manager.cc:5495] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:29.128456 29565 consensus_queue.cc:237] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:09:29.144426 29533 consensus_peers.cc:487] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1d695ebbb554e07b7258dc4e0368ce8. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:29.145538 29640 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:29.149336 30361 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:29.150444 29486 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:29.153481 30185 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:29.166672 30185 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.168684 29486 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.170320 29645 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.179396 29564 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.199177 29382 catalog_manager.cc:5495] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
W20260807 15:09:29.205354 29533 consensus_peers.cc:487] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62050f8fd36a4c19bd25be548475deb7. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:29.208384 29486 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:29.211445 29645 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:29.211330 30185 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:29.214115 30185 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:29.237365 30361 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.240154 29479 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.247649 29644 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:29.261270 29378 catalog_manager.cc:5495] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:29.470420 30378 ts_tablet_manager.cc:927] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:29.473234 30378 tablet_copy_client.cc:316] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:09:29.493933 29580 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:09:29.494719 29580 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet c8cd23e547af4b6eb4c91c08c1ce7d9a from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-c8cd23e547af4b6eb4c91c08c1ce7d9a
I20260807 15:09:29.503095 29580 tablet_copy_source_session.cc:205] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:29.508774 30378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:29.525163 30378 tablet_copy_client.cc:791] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:29.525972 30378 tablet_copy_client.cc:655] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:29.530783 30378 tablet_copy_client.cc:531] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:29.539696 30378 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:29.564247 30378 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:29.566700 30378 tablet_bootstrap.cc:492] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:29.567435 30378 ts_tablet_manager.cc:1397] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.028s user 0.017s sys 0.009s
I20260807 15:09:29.570586 30378 raft_consensus.cc:348] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.571553 30378 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:29.572253 30378 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.576613 30378 ts_tablet_manager.cc:1428] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.009s user 0.009s sys 0.001s
I20260807 15:09:29.581547 29580 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-c8cd23e547af4b6eb4c91c08c1ce7d9a received from {username='slave'} at 127.0.0.1:60682
I20260807 15:09:29.582062 29580 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-c8cd23e547af4b6eb4c91c08c1ce7d9a on tablet c8cd23e547af4b6eb4c91c08c1ce7d9a with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:29.586457 30378 ts_tablet_manager.cc:927] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:29.613572 30378 tablet_copy_client.cc:316] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:29.630039 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet 41559fba51e74c12a634f00bc225cd7b from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:29.630668 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet 41559fba51e74c12a634f00bc225cd7b from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-41559fba51e74c12a634f00bc225cd7b
I20260807 15:09:29.638772 29658 tablet_copy_source_session.cc:205] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:29.642125 30378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41559fba51e74c12a634f00bc225cd7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:29.663091 30378 tablet_copy_client.cc:791] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:29.663858 30378 tablet_copy_client.cc:655] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:29.667704 30378 tablet_copy_client.cc:531] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:29.681011 30378 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:29.702301 30378 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:29.703315 30378 tablet_bootstrap.cc:492] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:29.704074 30378 ts_tablet_manager.cc:1397] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.023s user 0.014s sys 0.009s
I20260807 15:09:29.706982 30378 raft_consensus.cc:348] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.707708 30378 raft_consensus.cc:729] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:29.708405 30378 consensus_queue.cc:260] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.710420 30378 ts_tablet_manager.cc:1428] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:09:29.713807 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-41559fba51e74c12a634f00bc225cd7b received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:29.714197 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-41559fba51e74c12a634f00bc225cd7b on tablet 41559fba51e74c12a634f00bc225cd7b with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:29.722218 30378 ts_tablet_manager.cc:927] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:29.724021 30378 tablet_copy_client.cc:316] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:09:29.725510 29580 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 62050f8fd36a4c19bd25be548475deb7 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:09:29.726081 29580 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 62050f8fd36a4c19bd25be548475deb7 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-62050f8fd36a4c19bd25be548475deb7
I20260807 15:09:29.733810 29580 tablet_copy_source_session.cc:205] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:29.736893 30378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62050f8fd36a4c19bd25be548475deb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:29.753819 30378 tablet_copy_client.cc:791] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:29.754032 30384 ts_tablet_manager.cc:927] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:29.754554 30378 tablet_copy_client.cc:655] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:29.755968 30384 tablet_copy_client.cc:316] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:09:29.757958 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet b1d695ebbb554e07b7258dc4e0368ce8 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:09:29.758538 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet b1d695ebbb554e07b7258dc4e0368ce8 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-b1d695ebbb554e07b7258dc4e0368ce8
I20260807 15:09:29.764549 30378 tablet_copy_client.cc:531] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:29.765764 29579 tablet_copy_source_session.cc:205] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:29.769137 30384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d695ebbb554e07b7258dc4e0368ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:29.773813 30378 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:29.791873 30378 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:29.792737 30378 tablet_bootstrap.cc:492] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:29.793170 30384 tablet_copy_client.cc:791] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:29.793377 30378 ts_tablet_manager.cc:1397] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.020s user 0.017s sys 0.003s
I20260807 15:09:29.793821 30384 tablet_copy_client.cc:655] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:29.796051 30378 raft_consensus.cc:348] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.796852 30378 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:29.797430 30378 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.799423 30378 ts_tablet_manager.cc:1428] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:09:29.801422 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-62050f8fd36a4c19bd25be548475deb7 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:09:29.801805 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-62050f8fd36a4c19bd25be548475deb7 on tablet 62050f8fd36a4c19bd25be548475deb7 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:29.804819 30384 tablet_copy_client.cc:531] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:29.814165 30384 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:29.833148 30384 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:29.834152 30384 tablet_bootstrap.cc:492] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:29.834856 30384 ts_tablet_manager.cc:1397] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.011s
I20260807 15:09:29.837874 30384 raft_consensus.cc:348] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.839062 30384 raft_consensus.cc:729] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:29.839716 30384 consensus_queue.cc:260] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:29.842280 30384 ts_tablet_manager.cc:1428] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 15:09:29.844113 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-b1d695ebbb554e07b7258dc4e0368ce8 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:09:29.844529 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-b1d695ebbb554e07b7258dc4e0368ce8 on tablet b1d695ebbb554e07b7258dc4e0368ce8 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:29.847155 30312 raft_consensus.cc:1203] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:30.124794 30312 raft_consensus.cc:1203] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:30.201485 30312 raft_consensus.cc:1203] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:30.236527 30361 raft_consensus.cc:1050] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:30.239310 30361 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:30.248672 29645 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.250739 29483 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.250972 30350 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:30.253749 30312 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.256362 30350 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:30.264272 30350 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:30.268159 30185 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.274190 29479 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.282418 29641 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.290882 30312 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.300576 29378 catalog_manager.cc:5495] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:30.355727 29564 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:30.368677 30312 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:30.368865 29641 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:30.370059 30361 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:30.371626 30361 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:30.376189 30311 raft_consensus.cc:1203] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:30.380292 30185 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.385250 29641 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.389930 30311 raft_consensus.cc:2932] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.401022 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:30.404716 29382 catalog_manager.cc:5495] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.429849 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet c8cd23e547af4b6eb4c91c08c1ce7d9a with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:09:30.447757 30403 tablet_replica.cc:330] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:09:30.449110 30403 raft_consensus.cc:2229] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:30.450963 30403 raft_consensus.cc:2258] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:30.456774 30403 ts_tablet_manager.cc:1905] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:30.474005 30403 ts_tablet_manager.cc:1918] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:30.474701 30403 log.cc:1196] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/c8cd23e547af4b6eb4c91c08c1ce7d9a
I20260807 15:09:30.477614 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet c8cd23e547af4b6eb4c91c08c1ce7d9a (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:30.709681 30402 raft_consensus.cc:1050] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:30.712376 30402 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:30.719362 29644 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.719513 30311 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.720868 30402 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:30.722234 30394 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:30.722465 29483 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.725526 30394 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:30.743093 30402 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.744642 30311 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.757252 29483 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.768121 29382 catalog_manager.cc:5495] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:30.771284 29641 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.809675 30392 raft_consensus.cc:1050] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:30.812085 30392 consensus_queue.cc:237] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:30.813786 29565 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:30.818636 30311 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:30.820509 29644 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:30.820313 30394 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:30.824055 30311 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.824239 29565 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.823374 30394 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:30.830471 29486 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.830176 30394 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.832482 30367 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:30.832813 30311 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.834488 30367 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:30.839735 30366 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:30.847211 29644 raft_consensus.cc:2932] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.857297 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 62050f8fd36a4c19bd25be548475deb7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:30.868669 29382 catalog_manager.cc:5495] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:30.898738 30185 raft_consensus.cc:1050] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:30.902014 30185 consensus_queue.cc:237] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:30.908028 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet 62050f8fd36a4c19bd25be548475deb7 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:09:30.909782 30403 tablet_replica.cc:330] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:09:30.911262 30403 raft_consensus.cc:2229] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:30.912402 30403 raft_consensus.cc:2258] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:30.922959 30403 ts_tablet_manager.cc:1905] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:30.952327 30312 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.953418 29645 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.955402 30394 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:30.965322 30394 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260807 15:09:30.978176 30403 ts_tablet_manager.cc:1918] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:30.978936 30403 log.cc:1196] T 62050f8fd36a4c19bd25be548475deb7 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/62050f8fd36a4c19bd25be548475deb7
I20260807 15:09:30.977030 30366 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:30.985651 29481 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:30.993109 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet 62050f8fd36a4c19bd25be548475deb7 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:30.996891 29486 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.004172 30361 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 15:09:31.013664 29570 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.021293 29379 catalog_manager.cc:5495] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:31.001008 30312 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.047518 29640 consensus_queue.cc:237] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:31.073949 30350 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.079214 29641 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.136314 29382 catalog_manager.cc:5495] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.148473 30311 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:31.164399 30392 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:31.164304 30312 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.178156 30366 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.190706 29486 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:31.196913 30311 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.196403 29483 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.210263 30367 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:31.225158 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 41559fba51e74c12a634f00bc225cd7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:31.231513 29379 catalog_manager.cc:5495] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:31.252600 29486 raft_consensus.cc:2932] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.255324 29565 consensus_queue.cc:237] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:31.270335 30312 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:31.271013 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet 41559fba51e74c12a634f00bc225cd7b with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:09:31.271417 29481 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:31.274669 30350 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:31.282838 30350 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:31.295625 30424 tablet_replica.cc:330] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:09:31.297595 30424 raft_consensus.cc:2229] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:31.298847 30424 raft_consensus.cc:2258] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:31.302960 30424 ts_tablet_manager.cc:1905] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:31.317541 30312 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.318874 30423 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.327073 29481 raft_consensus.cc:2932] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.343133 29379 catalog_manager.cc:5495] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:31.345052 30424 ts_tablet_manager.cc:1918] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:31.345727 30424 log.cc:1196] T 41559fba51e74c12a634f00bc225cd7b P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/41559fba51e74c12a634f00bc225cd7b
I20260807 15:09:31.348073 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet 41559fba51e74c12a634f00bc225cd7b (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:31.360450 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet b1d695ebbb554e07b7258dc4e0368ce8 with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:31.366331 30425 tablet_replica.cc:330] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:09:31.368063 30425 raft_consensus.cc:2229] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:31.368992 30425 raft_consensus.cc:2258] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:31.372886 30425 ts_tablet_manager.cc:1905] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:31.375728 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet b1d695ebbb554e07b7258dc4e0368ce8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:31.461385 30425 ts_tablet_manager.cc:1918] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:31.462250 30425 log.cc:1196] T b1d695ebbb554e07b7258dc4e0368ce8 P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/b1d695ebbb554e07b7258dc4e0368ce8
I20260807 15:09:31.467942 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet b1d695ebbb554e07b7258dc4e0368ce8 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:32.467828 29481 consensus_queue.cc:237] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:32.475518 29565 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:32.477775 30430 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:32.478152 29641 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:32.481484 30430 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:32.491055 30421 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.497556 29641 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
W20260807 15:09:32.499716 29452 consensus_peers.cc:487] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 574818cf180d48a68d8b72da65c22af5. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:32.501523 29565 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.510412 29479 consensus_queue.cc:237] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:32.516175 29380 catalog_manager.cc:5495] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260807 15:09:32.539697 29452 consensus_peers.cc:487] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c10b42b2212f45838c83e394b00482df. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:32.543263 29641 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:32.545912 30430 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:32.548879 29565 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:32.551995 30421 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:32.562353 30430 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.565999 29641 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.568239 29565 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.587785 29479 consensus_queue.cc:237] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:32.600203 29382 catalog_manager.cc:5495] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
W20260807 15:09:32.604542 29452 consensus_peers.cc:487] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9fd4477c59ed4f0181a2d23b25c4a030. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:32.606554 29641 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:32.608254 30430 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:32.606345 29565 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:32.616374 30430 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:32.635824 30408 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.637544 29570 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.649014 29642 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.661511 29382 catalog_manager.cc:5495] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.665387 29641 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:32.687572 29486 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:32.687590 29570 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 15:09:32.688369 29609 consensus_peers.cc:487] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb8a4d13c18e42ff82894fddfb0c0f0f. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:32.689438 30410 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:32.691423 30443 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:32.701431 30410 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.703260 29570 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.708849 29486 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:32.735117 29380 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:33.025329 30451 ts_tablet_manager.cc:927] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:33.026971 30451 tablet_copy_client.cc:316] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:33.043551 29499 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet 574818cf180d48a68d8b72da65c22af5 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:33.044142 29499 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet 574818cf180d48a68d8b72da65c22af5 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-574818cf180d48a68d8b72da65c22af5
I20260807 15:09:33.052927 29499 tablet_copy_source_session.cc:205] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:33.055940 30451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574818cf180d48a68d8b72da65c22af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:33.074705 30451 tablet_copy_client.cc:791] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:33.075309 30451 tablet_copy_client.cc:655] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:33.079845 30451 tablet_copy_client.cc:531] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:33.088258 30451 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:33.108345 30451 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:33.109234 30451 tablet_bootstrap.cc:492] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:33.109943 30451 ts_tablet_manager.cc:1397] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.022s user 0.021s sys 0.000s
I20260807 15:09:33.112622 30451 raft_consensus.cc:348] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:33.113418 30451 raft_consensus.cc:729] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:33.114027 30451 consensus_queue.cc:260] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:33.117504 30451 ts_tablet_manager.cc:1428] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260807 15:09:33.119658 29499 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-574818cf180d48a68d8b72da65c22af5 received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:33.120051 29499 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-574818cf180d48a68d8b72da65c22af5 on tablet 574818cf180d48a68d8b72da65c22af5 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:33.123801 30451 ts_tablet_manager.cc:927] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:33.169305 30451 tablet_copy_client.cc:316] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:33.171341 29499 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet 9fd4477c59ed4f0181a2d23b25c4a030 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:33.172096 29499 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet 9fd4477c59ed4f0181a2d23b25c4a030 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-9fd4477c59ed4f0181a2d23b25c4a030
I20260807 15:09:33.174326 30457 ts_tablet_manager.cc:927] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:33.179734 30457 tablet_copy_client.cc:316] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:33.183183 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet c10b42b2212f45838c83e394b00482df from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:33.184053 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet c10b42b2212f45838c83e394b00482df from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-c10b42b2212f45838c83e394b00482df
I20260807 15:09:33.187152 29499 tablet_copy_source_session.cc:205] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:33.197808 29498 tablet_copy_source_session.cc:205] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:33.199460 30451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fd4477c59ed4f0181a2d23b25c4a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:33.203538 30457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c10b42b2212f45838c83e394b00482df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:33.226523 30451 tablet_copy_client.cc:791] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:33.227695 30451 tablet_copy_client.cc:655] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:33.233764 30457 tablet_copy_client.cc:791] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:33.234464 30457 tablet_copy_client.cc:655] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:33.242681 30457 tablet_copy_client.cc:531] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:33.248004 30451 tablet_copy_client.cc:531] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:33.253999 30457 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:33.259024 30451 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:33.292448 30451 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:33.293514 30451 tablet_bootstrap.cc:492] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:33.294127 30457 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:33.294281 30451 ts_tablet_manager.cc:1397] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.035s user 0.025s sys 0.003s
I20260807 15:09:33.296115 30457 tablet_bootstrap.cc:492] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:33.297619 30457 ts_tablet_manager.cc:1397] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.044s user 0.027s sys 0.011s
I20260807 15:09:33.297808 30451 raft_consensus.cc:348] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:33.298913 30451 raft_consensus.cc:729] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:33.299655 30451 consensus_queue.cc:260] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:33.301524 30457 raft_consensus.cc:348] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:33.302380 30457 raft_consensus.cc:729] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:33.303524 30451 ts_tablet_manager.cc:1428] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260807 15:09:33.303599 30457 consensus_queue.cc:260] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:33.305768 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-9fd4477c59ed4f0181a2d23b25c4a030 received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:33.306205 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-9fd4477c59ed4f0181a2d23b25c4a030 on tablet 9fd4477c59ed4f0181a2d23b25c4a030 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:33.307405 30457 ts_tablet_manager.cc:1428] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260807 15:09:33.310771 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-c10b42b2212f45838c83e394b00482df received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:33.311304 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-c10b42b2212f45838c83e394b00482df on tablet c10b42b2212f45838c83e394b00482df with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:33.316701 30457 ts_tablet_manager.cc:927] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:33.327337 30457 tablet_copy_client.cc:316] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:33.329350 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet fb8a4d13c18e42ff82894fddfb0c0f0f from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:33.329984 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet fb8a4d13c18e42ff82894fddfb0c0f0f from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-fb8a4d13c18e42ff82894fddfb0c0f0f
I20260807 15:09:33.340036 29658 tablet_copy_source_session.cc:205] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:33.343380 30457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8a4d13c18e42ff82894fddfb0c0f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:33.360689 30457 tablet_copy_client.cc:791] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:33.361434 30457 tablet_copy_client.cc:655] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:33.365761 30457 tablet_copy_client.cc:531] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:33.373989 30457 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:33.410748 30457 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:33.412415 30457 tablet_bootstrap.cc:492] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:33.413738 30457 ts_tablet_manager.cc:1397] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.040s user 0.021s sys 0.016s
I20260807 15:09:33.424968 30457 raft_consensus.cc:348] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:33.428768 30457 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:33.430270 30457 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:33.438192 30457 ts_tablet_manager.cc:1428] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.024s user 0.010s sys 0.004s
I20260807 15:09:33.442260 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-fb8a4d13c18e42ff82894fddfb0c0f0f received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:33.443576 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-fb8a4d13c18e42ff82894fddfb0c0f0f on tablet fb8a4d13c18e42ff82894fddfb0c0f0f with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:33.582504 30312 raft_consensus.cc:1203] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:33.652894 30312 raft_consensus.cc:1203] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:33.688508 30312 raft_consensus.cc:1203] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:33.860677 30312 raft_consensus.cc:1203] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:34.111357 30421 raft_consensus.cc:1050] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:34.116113 30421 consensus_queue.cc:237] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:34.131664 29642 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:34.135015 30447 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:34.132084 30312 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:34.145001 30466 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:34.150002 29565 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:34.162423 30467 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:34.186486 30467 raft_consensus.cc:1050] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:34.211282 30421 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:34.274866 29565 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:34.288642 30312 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:34.282001 30467 consensus_queue.cc:237] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:34.308864 30473 raft_consensus.cc:1050] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:34.368041 30443 raft_consensus.cc:1050] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:34.380200 30311 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260807 15:09:34.380839 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 48257.3us
I20260807 15:09:34.385412 29644 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:34.381748 29564 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:34.387317 30474 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 15:09:34.424906 29382 catalog_manager.cc:5495] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:34.502630 30473 consensus_queue.cc:237] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:09:34.587452 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 73734.6us
I20260807 15:09:34.525738 30443 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:09:34.666155 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 67066.8us
I20260807 15:09:34.684759 29644 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:34.698226 30465 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 15:09:34.716463 30467 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:35.021243 30311 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:35.029440 30473 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 15:09:35.087426 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 423930us
I20260807 15:09:35.140444 29641 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:35.180670 29569 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:35.264077 30481 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:09:35.269060 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 363074us
I20260807 15:09:35.273887 30481 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:35.331391 30490 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260807 15:09:35.339219 29479 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260807 15:09:35.325456 30504 log.cc:924] Time spent T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.055s user 0.000s sys 0.003s
I20260807 15:09:35.398583 30309 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:35.431102 29567 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:35.413977 30492 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260807 15:09:35.488052 30481 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:35.457234 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:35.487459 30489 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260807 15:09:35.592629 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 122258us
W20260807 15:09:35.629972 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 163037us
W20260807 15:09:35.707474 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 87128.4us
W20260807 15:09:35.721241 30519 log.cc:924] Time spent T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.068s user 0.001s sys 0.001s
I20260807 15:09:35.734117 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:35.740577 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 181659us
W20260807 15:09:35.765309 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 112457us
I20260807 15:09:35.772126 29531 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:35.791486 30515 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.180s user 0.002s sys 0.001s
I20260807 15:09:35.791829 30494 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:35.766402 30478 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:09:35.795516 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 356297us
I20260807 15:09:35.798488 30526 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:35.799773 30526 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:35.816713 30526 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:35.939680 30309 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:35.966985 29382 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48690 (request call id 168) took 1559 ms. Trace:
I20260807 15:09:35.965821 30527 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260807 15:09:35.973863 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 148) took 1074 ms. Trace:
I20260807 15:09:35.999644 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:35.979328 29378 rpcz_store.cc:276] 0807 15:09:34.899633 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:34.899951 (+ 318us) service_pool.cc:227] Handling call
0807 15:09:35.973745 (+1073794us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260807 15:09:35.992357 29645 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.105486 29380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 33) took 1449 ms. Trace:
I20260807 15:09:36.139876 29380 rpcz_store.cc:276] 0807 15:09:34.638701 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:34.639060 (+ 359us) service_pool.cc:227] Handling call
0807 15:09:34.948462 (+309402us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e1d1ed6c 00007f94e1e18c3e 00007f94e012afb4 00007f94e012af42 00007f94e012ae71 00007f94e012adec 00007f94e012a0a2 00007f94da1ee94c 00007f94da1edd86
0807 15:09:36.087836 (+1139374us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":541775104}
I20260807 15:09:35.975333 29382 rpcz_store.cc:276] 0807 15:09:34.407661 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:34.407866 (+ 205us) service_pool.cc:227] Handling call
0807 15:09:35.966730 (+1558864us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:09:34.566853 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:09:34.568656 (+ 1803us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:09:34.568738 (+ 82us) write_op.cc:435] Acquired schema lock
0807 15:09:34.568794 (+ 56us) tablet.cc:660] Decoding operations
0807 15:09:34.569877 (+ 1083us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:09:34.570229 (+ 352us) write_op.cc:641] Partition lock acquired for write op
0807 15:09:34.570348 (+ 119us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:09:34.570883 (+ 535us) tablet.cc:699] Row locks acquired
0807 15:09:34.570958 (+ 75us) write_op.cc:260] PREPARE: finished
0807 15:09:34.571435 (+ 477us) write_op.cc:270] Start()
0807 15:09:34.571714 (+ 279us) write_op.cc:276] Timestamp: P: 1786115374571327 usec, L: 0
0807 15:09:34.571857 (+ 143us) op_driver.cc:331] REPLICATION: starting
0807 15:09:34.606752 (+ 34895us) log.cc:842] Serialized 602 byte log entry
0807 15:09:35.396846 (+790094us) op_driver.cc:444] REPLICATION: finished
0807 15:09:35.798208 (+401362us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b18002fe240. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:09:35.798447 (+ 239us) write_op.cc:301] APPLY: starting
0807 15:09:35.798609 (+ 162us) tablet.cc:1365] starting BulkCheckPresence
0807 15:09:35.798815 (+ 206us) tablet.cc:1368] finished BulkCheckPresence
0807 15:09:35.798859 (+ 44us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:09:35.799259 (+ 400us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:09:35.799665 (+ 406us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:09:35.799778 (+ 113us) write_op.cc:312] APPLY: finished
0807 15:09:35.800253 (+ 475us) log.cc:842] Serialized 22 byte log entry
0807 15:09:35.800552 (+ 299us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:09:35.800694 (+ 142us) write_op.cc:454] Released schema lock
0807 15:09:35.800772 (+ 78us) write_op.cc:341] FINISH: Updating metrics
0807 15:09:35.821108 (+ 20336us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:09:35.822933 (+ 1825us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":177613,"apply.run_cpu_time_us":3672,"apply.run_wall_time_us":31527,"num_ops":1,"prepare.queue_time_us":108029,"prepare.run_cpu_time_us":39185,"prepare.run_wall_time_us":308432,"raft.queue_time_us":370720,"raft.run_cpu_time_us":24846,"raft.run_wall_time_us":219947,"replication_time_us":815395,"spinlock_wait_cycles":17436544,"thread_start_us":761813,"threads_started":4,"wal-append.queue_time_us":381357}]]}
I20260807 15:09:36.136225 29379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 151) took 1359 ms. Trace:
W20260807 15:09:36.163365 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 387963us
I20260807 15:09:36.165203 29379 rpcz_store.cc:276] 0807 15:09:34.776958 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:34.777340 (+ 382us) service_pool.cc:227] Handling call
0807 15:09:34.883115 (+105775us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e1d1ed6c 00007f94e1e18c3e 00007f94e012afb4 00007f94e012af42 00007f94e012ae71 00007f94e012adec 00007f94e012a0a2 00007f94da1ee94c 00007f94da1edd86
0807 15:09:36.136119 (+1253004us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26490,"reported_tablets":1,"spinlock_wait_cycles":218722048}
I20260807 15:09:36.167845 30492 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:36.190457 30492 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:36.204448 30492 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:36.196439 30423 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:36.207335 30423 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:36.223155 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 407102us
W20260807 15:09:36.228475 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 51738.7us
I20260807 15:09:36.296482 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:36.304348 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:36.306303 30423 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:36.326565 30521 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260807 15:09:36.337556 30541 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:09:36.350024 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 436104us
I20260807 15:09:36.352825 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:36.357918 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:36.369120 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:36.368835 30473 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.347918 30541 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:36.382652 29487 consensus_queue.cc:237] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:36.401180 30537 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:36.401878 30537 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:36.419121 30537 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:36.428901 29531 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:36.438400 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:36.439430 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:36.479245 29564 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:09:36.489826 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 61116.7us
W20260807 15:09:36.510085 30545 log.cc:924] Time spent T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
W20260807 15:09:36.513538 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 69005us
I20260807 15:09:36.518833 30541 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:36.524184 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:36.526856 30309 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:36.511068 30482 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:36.533973 30492 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:36.456993 30528 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.539001 29382 catalog_manager.cc:5495] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.546016 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:09:36.535585 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 126034us
W20260807 15:09:36.536087 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 125770us
I20260807 15:09:36.565412 29450 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:36.571369 30525 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:36.571300 29450 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:36.573712 30478 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:09:36.583470 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 115557us
I20260807 15:09:36.598898 29647 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.604357 30273 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:36.609593 30541 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:36.628412 30311 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.652498 29481 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:09:36.711655 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 44414.3us
W20260807 15:09:36.718456 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 131064us
W20260807 15:09:36.728935 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 261156us
W20260807 15:09:36.730419 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 133021us
I20260807 15:09:36.755515 29641 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:36.761540 29531 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:36.763794 29564 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.749441 29567 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.786983 30312 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.779121 30474 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260807 15:09:36.840145 30481 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:36.875267 30492 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:36.911921 30474 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.909479 30492 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:36.931190 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 48576us
W20260807 15:09:36.956894 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 135602us
I20260807 15:09:36.982793 30482 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:36.983681 30482 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:36.983295 30312 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:36.987812 30482 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:36.995605 30492 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:37.005767 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:37.021733 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 54206.9us
I20260807 15:09:37.057500 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:37.060618 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 212860us
W20260807 15:09:37.066093 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 53666.9us
I20260807 15:09:37.113560 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:09:37.141697 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 74563us
W20260807 15:09:37.126173 30561 log.cc:924] Time spent T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.065s user 0.000s sys 0.001s
I20260807 15:09:37.148700 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33668 (request call id 219) took 1008 ms. Trace:
I20260807 15:09:37.149274 30474 rpcz_store.cc:276] 0807 15:09:36.139925 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:36.143016 (+ 3091us) service_pool.cc:227] Handling call
0807 15:09:36.278728 (+135712us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b2c00060e78. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94da7a7e11 00007f94da7b6ada 00007f94da7b6763 00007f94da7b6701 00007f94dbdffb12 00007f94dbdff8ed 00007f94dbdcaf84 00007f94dbdca743 00007f94dbdc2c1a 00007f94e0d066d9 00007f94da3f0184
0807 15:09:36.381196 (+102468us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b540039dda0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd54834 00007f94dbdbfc47 00007f94dbdcb084 00007f94dbdca743 00007f94dbdc2c1a 00007f94e0d066d9 00007f94da3f0184 00007f94da3f0112 00007f94da3f0041 00007f94da3effbc
0807 15:09:36.404486 (+ 23290us) log.cc:842] Serialized 508 byte log entry
0807 15:09:36.628169 (+223683us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b180019f840. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:09:37.148591 (+520422us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":34612,"raft.run_cpu_time_us":1625,"raft.run_wall_time_us":52111,"spinlock_wait_cycles":60720000,"thread_start_us":4572,"threads_started":1,"wal-append.queue_time_us":2694}
I20260807 15:09:37.181540 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:37.185160 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:37.190249 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c10b42b2212f45838c83e394b00482df with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:37.215358 29450 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:37.216641 30474 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:37.232290 29533 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:37.234087 30503 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:37.235740 29645 raft_consensus.cc:2932] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.246313 29378 catalog_manager.cc:5495] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:37.252874 29378 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.293138 29483 consensus_queue.cc:237] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:37.297178 29486 consensus_queue.cc:237] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:37.303541 29567 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:37.312924 30312 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:37.307021 30467 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:37.316406 30554 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:37.318955 30312 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260807 15:09:37.326752 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 46416.1us
I20260807 15:09:37.335705 29645 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:37.297955 29382 catalog_manager.cc:5495] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.337914 30474 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260807 15:09:37.354943 30526 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:37.363329 30478 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.387979 30312 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.392460 29570 raft_consensus.cc:2932] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.400780 30526 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.408120 29645 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.424996 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet c10b42b2212f45838c83e394b00482df with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:09:37.445092 30567 tablet_replica.cc:330] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:09:37.419713 29643 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:37.458062 29382 catalog_manager.cc:5495] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.462090 29379 catalog_manager.cc:5495] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.464391 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 574818cf180d48a68d8b72da65c22af5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:37.473730 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 9fd4477c59ed4f0181a2d23b25c4a030 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:37.475144 30567 raft_consensus.cc:2229] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:37.492182 30567 raft_consensus.cc:2258] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:37.504724 29570 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:37.511822 30567 ts_tablet_manager.cc:1905] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:37.514488 30311 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:37.521540 30312 raft_consensus.cc:2932] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.535429 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fd4477c59ed4f0181a2d23b25c4a030 with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:09:37.528405 30490 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260807 15:09:37.542546 30512 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260807 15:09:37.568539 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet 574818cf180d48a68d8b72da65c22af5 with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:37.604856 30518 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.606300 29566 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.608788 30311 raft_consensus.cc:2932] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.612373 30569 tablet_replica.cc:330] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:09:37.627092 29382 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:37.643388 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet fb8a4d13c18e42ff82894fddfb0c0f0f with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:09:37.646457 30567 ts_tablet_manager.cc:1918] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:37.647190 30567 log.cc:1196] T c10b42b2212f45838c83e394b00482df P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/c10b42b2212f45838c83e394b00482df
I20260807 15:09:37.648525 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet fb8a4d13c18e42ff82894fddfb0c0f0f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:37.650492 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet c10b42b2212f45838c83e394b00482df (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:37.650959 30567 tablet_replica.cc:330] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:09:37.663275 30569 raft_consensus.cc:2229] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:37.665448 30569 raft_consensus.cc:2258] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:37.671730 30569 ts_tablet_manager.cc:1905] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:37.683984 30570 tablet_replica.cc:330] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:09:37.684901 30570 raft_consensus.cc:2229] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:37.685652 30570 raft_consensus.cc:2258] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:37.688910 30570 ts_tablet_manager.cc:1905] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:37.697083 30567 raft_consensus.cc:2229] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:37.702409 30567 raft_consensus.cc:2258] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:37.705474 30567 ts_tablet_manager.cc:1905] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:37.707278 30570 ts_tablet_manager.cc:1918] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:37.707924 30570 log.cc:1196] T fb8a4d13c18e42ff82894fddfb0c0f0f P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/fb8a4d13c18e42ff82894fddfb0c0f0f
I20260807 15:09:37.710377 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet fb8a4d13c18e42ff82894fddfb0c0f0f (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:37.711351 30569 ts_tablet_manager.cc:1918] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:37.711872 30569 log.cc:1196] T 574818cf180d48a68d8b72da65c22af5 P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/574818cf180d48a68d8b72da65c22af5
I20260807 15:09:37.713532 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet 574818cf180d48a68d8b72da65c22af5 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:37.724555 30567 ts_tablet_manager.cc:1918] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:37.725083 30567 log.cc:1196] T 9fd4477c59ed4f0181a2d23b25c4a030 P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/9fd4477c59ed4f0181a2d23b25c4a030
I20260807 15:09:37.727087 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet 9fd4477c59ed4f0181a2d23b25c4a030 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:38.761612 29483 consensus_queue.cc:237] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:38.769783 29645 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:38.769802 29566 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 15:09:38.770007 29452 consensus_peers.cc:487] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 530a2932f7854f95a0380cbbf05f57bf. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:38.771317 30467 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:38.772310 30573 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:38.781206 30573 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.783468 29645 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.787985 29566 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.803772 29377 catalog_manager.cc:5495] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.834445 29645 consensus_queue.cc:237] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:09:38.853132 29609 consensus_peers.cc:487] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2fe1df4603dd4ecdad74103a84926118. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:38.853224 29566 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:38.853076 29483 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:38.855022 30518 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:38.856170 30488 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:38.866267 30572 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.884596 29480 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.890098 29643 consensus_queue.cc:237] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:38.892333 29566 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.903306 29382 catalog_manager.cc:5495] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:38.913151 29564 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:38.917182 29480 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:38.919413 30518 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:38.921209 30488 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260807 15:09:38.929284 29609 consensus_peers.cc:487] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7645f7cacdb34a1486686ba6f848e1bb. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:38.941125 30518 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.945233 29564 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.950206 29480 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.966117 29486 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:38.976989 29643 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:38.978695 30575 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 15:09:38.982978 29452 consensus_peers.cc:487] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4db6cf72c3b74ea19f67f0d479e0b364. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:38.986966 29564 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:38.987471 29380 catalog_manager.cc:5495] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:38.990123 30554 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:38.999591 30554 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:39.003021 29645 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:39.015736 29564 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:39.034063 29380 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:39.333784 30594 ts_tablet_manager.cc:927] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:39.335704 30594 tablet_copy_client.cc:316] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:39.337626 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet 2fe1df4603dd4ecdad74103a84926118 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:39.338091 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet 2fe1df4603dd4ecdad74103a84926118 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-2fe1df4603dd4ecdad74103a84926118
I20260807 15:09:39.345891 29658 tablet_copy_source_session.cc:205] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:39.351135 30594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fe1df4603dd4ecdad74103a84926118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:39.367025 30596 ts_tablet_manager.cc:927] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:39.367822 30594 tablet_copy_client.cc:791] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:39.368542 30594 tablet_copy_client.cc:655] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:39.372526 30594 tablet_copy_client.cc:531] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:39.373416 30596 tablet_copy_client.cc:316] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:39.375484 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet 530a2932f7854f95a0380cbbf05f57bf from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:39.376067 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet 530a2932f7854f95a0380cbbf05f57bf from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-530a2932f7854f95a0380cbbf05f57bf
I20260807 15:09:39.385056 30594 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:39.396359 30598 ts_tablet_manager.cc:927] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:39.397272 29498 tablet_copy_source_session.cc:205] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:39.403609 30598 tablet_copy_client.cc:316] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:39.404250 30596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 530a2932f7854f95a0380cbbf05f57bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:39.406890 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet 7645f7cacdb34a1486686ba6f848e1bb from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:39.407436 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet 7645f7cacdb34a1486686ba6f848e1bb from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-7645f7cacdb34a1486686ba6f848e1bb
I20260807 15:09:39.413996 30594 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:39.414700 29658 tablet_copy_source_session.cc:205] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:39.414816 30594 tablet_bootstrap.cc:492] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:39.416321 30594 ts_tablet_manager.cc:1397] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.032s user 0.025s sys 0.000s
I20260807 15:09:39.418864 30598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7645f7cacdb34a1486686ba6f848e1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:39.419680 30594 raft_consensus.cc:348] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:39.424463 30594 raft_consensus.cc:729] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:39.425328 30594 consensus_queue.cc:260] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:39.435789 30598 tablet_copy_client.cc:791] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:39.436565 30598 tablet_copy_client.cc:655] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:39.442909 30594 ts_tablet_manager.cc:1428] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.026s user 0.014s sys 0.000s
I20260807 15:09:39.444151 30596 tablet_copy_client.cc:791] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:39.444729 30596 tablet_copy_client.cc:655] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:39.445762 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-2fe1df4603dd4ecdad74103a84926118 received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:39.446354 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-2fe1df4603dd4ecdad74103a84926118 on tablet 2fe1df4603dd4ecdad74103a84926118 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:39.450328 30596 tablet_copy_client.cc:531] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:39.450537 30594 ts_tablet_manager.cc:927] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:39.454461 30598 tablet_copy_client.cc:531] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:39.463567 30598 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:39.464221 30596 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:39.467818 30594 tablet_copy_client.cc:316] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:39.473515 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet 4db6cf72c3b74ea19f67f0d479e0b364 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:39.474103 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet 4db6cf72c3b74ea19f67f0d479e0b364 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-4db6cf72c3b74ea19f67f0d479e0b364
I20260807 15:09:39.495319 29498 tablet_copy_source_session.cc:205] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:39.499190 30594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db6cf72c3b74ea19f67f0d479e0b364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:39.504164 30598 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:39.505000 30598 tablet_bootstrap.cc:492] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:39.507784 30598 ts_tablet_manager.cc:1397] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.044s user 0.016s sys 0.016s
I20260807 15:09:39.519460 30594 tablet_copy_client.cc:791] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:39.520323 30594 tablet_copy_client.cc:655] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:39.524087 30598 raft_consensus.cc:348] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:39.525087 30598 raft_consensus.cc:729] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:39.525872 30598 consensus_queue.cc:260] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:39.528291 30598 ts_tablet_manager.cc:1428] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 15:09:39.517833 30596 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:39.529440 30596 tablet_bootstrap.cc:492] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:39.530187 30596 ts_tablet_manager.cc:1397] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.066s user 0.025s sys 0.007s
I20260807 15:09:39.532929 30596 raft_consensus.cc:348] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:39.534282 30596 raft_consensus.cc:729] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:39.534938 30596 consensus_queue.cc:260] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:39.537447 30596 ts_tablet_manager.cc:1428] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260807 15:09:39.539217 29499 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-530a2932f7854f95a0380cbbf05f57bf received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:39.539624 29499 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-530a2932f7854f95a0380cbbf05f57bf on tablet 530a2932f7854f95a0380cbbf05f57bf with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:39.539752 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-7645f7cacdb34a1486686ba6f848e1bb received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:39.540251 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-7645f7cacdb34a1486686ba6f848e1bb on tablet 7645f7cacdb34a1486686ba6f848e1bb with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:39.544549 30594 tablet_copy_client.cc:531] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:39.555205 30594 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:39.576330 30594 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:39.577236 30594 tablet_bootstrap.cc:492] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:39.577876 30594 ts_tablet_manager.cc:1397] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.023s user 0.014s sys 0.008s
I20260807 15:09:39.581167 30594 raft_consensus.cc:348] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:39.581882 30594 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:39.582468 30594 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:39.584883 30594 ts_tablet_manager.cc:1428] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:09:39.586494 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-4db6cf72c3b74ea19f67f0d479e0b364 received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:39.586884 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-4db6cf72c3b74ea19f67f0d479e0b364 on tablet 4db6cf72c3b74ea19f67f0d479e0b364 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:39.822084 30311 raft_consensus.cc:1203] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:39.837790 30311 raft_consensus.cc:1203] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:39.860801 30311 raft_consensus.cc:1203] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:39.966732 30311 raft_consensus.cc:1203] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:40.297542 30572 raft_consensus.cc:1050] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:40.299979 30572 consensus_queue.cc:237] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:40.312563 30311 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.313416 29567 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.314635 30610 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:40.317968 29483 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.319175 30572 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:40.325199 30609 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:40.345011 30572 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.348064 30311 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.355372 29486 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.361358 29567 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.366430 29382 catalog_manager.cc:5495] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.400003 29643 consensus_queue.cc:237] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:40.405046 30311 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:40.405076 29480 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:40.407241 30609 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:40.409027 30572 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:40.417192 30613 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.419004 30311 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.432354 30575 raft_consensus.cc:1050] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:40.433202 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7645f7cacdb34a1486686ba6f848e1bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:40.434921 30575 consensus_queue.cc:237] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:40.445164 29480 raft_consensus.cc:2932] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.447042 29379 catalog_manager.cc:5495] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:40.459287 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet 7645f7cacdb34a1486686ba6f848e1bb with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:09:40.473485 30624 tablet_replica.cc:330] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:09:40.473507 30312 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.476728 30554 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:40.483951 30624 raft_consensus.cc:2229] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:40.484805 30624 raft_consensus.cc:2258] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:40.497138 29641 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.499061 29567 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.500813 30624 ts_tablet_manager.cc:1905] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:40.501464 30610 raft_consensus.cc:1050] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:40.513422 30610 consensus_queue.cc:237] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:40.503294 30467 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:40.517946 30554 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:40.550173 30312 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.548229 30467 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.555771 29483 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.558624 30610 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:40.559661 29570 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.562292 30572 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:40.570222 30613 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:40.564954 29641 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:09:40.579255 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 64384.9us
I20260807 15:09:40.603600 30554 raft_consensus.cc:1050] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:40.603703 30311 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:09:40.624449 30631 log.cc:924] Time spent T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260807 15:09:40.608705 30554 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:40.652599 29570 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.661927 29379 catalog_manager.cc:5495] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:40.684376 30611 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.700243 30624 ts_tablet_manager.cc:1918] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:40.712320 30624 log.cc:1196] T 7645f7cacdb34a1486686ba6f848e1bb P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/7645f7cacdb34a1486686ba6f848e1bb
I20260807 15:09:40.725284 29487 consensus_queue.cc:237] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:40.734918 30312 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:40.737392 30626 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:40.748369 30311 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.749044 29643 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.750749 30554 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:40.753463 30575 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.755424 30312 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.761444 30554 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:40.774785 29379 catalog_manager.cc:5495] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.783529 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 530a2932f7854f95a0380cbbf05f57bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:40.796689 29487 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.800447 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet 530a2932f7854f95a0380cbbf05f57bf with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46792
W20260807 15:09:40.808095 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 94448.6us
I20260807 15:09:40.813426 29567 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.817744 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet 7645f7cacdb34a1486686ba6f848e1bb (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:40.820912 30645 tablet_replica.cc:330] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:09:40.822199 30645 raft_consensus.cc:2229] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:40.822888 30645 raft_consensus.cc:2258] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:40.822939 29570 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:40.828043 29570 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:40.829658 30311 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.836221 30467 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:40.836972 30627 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:40.853523 30626 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.857519 30645 ts_tablet_manager.cc:1905] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:40.853495 29641 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.878479 30311 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.862037 29564 raft_consensus.cc:2932] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:40.890723 29380 catalog_manager.cc:5495] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:40.960180 29379 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:40.970063 29642 consensus_queue.cc:237] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:40.986997 30311 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:40.994544 30638 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260807 15:09:40.997841 29570 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:41.001266 30611 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:41.026834 30645 ts_tablet_manager.cc:1918] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:41.027431 30645 log.cc:1196] T 530a2932f7854f95a0380cbbf05f57bf P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/530a2932f7854f95a0380cbbf05f57bf
I20260807 15:09:41.031008 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet 530a2932f7854f95a0380cbbf05f57bf (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:41.033601 30611 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:41.035844 29567 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:41.052371 30311 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:41.060806 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 2fe1df4603dd4ecdad74103a84926118 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:41.077867 29380 catalog_manager.cc:5495] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:41.091711 29567 raft_consensus.cc:2932] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:41.107496 29486 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:41.120478 30311 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:41.122749 30626 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:41.124919 29568 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:41.129707 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fe1df4603dd4ecdad74103a84926118 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:09:41.157488 30311 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:41.167124 30627 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:41.173060 30648 tablet_replica.cc:330] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:09:41.154018 30575 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:41.183305 30648 raft_consensus.cc:2229] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:41.184799 30648 raft_consensus.cc:2258] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:41.184984 29379 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:41.190233 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4db6cf72c3b74ea19f67f0d479e0b364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:41.204540 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet 4db6cf72c3b74ea19f67f0d479e0b364 with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:41.206214 30645 tablet_replica.cc:330] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:09:41.207629 30645 raft_consensus.cc:2229] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:41.240696 30645 raft_consensus.cc:2258] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:41.240320 30648 ts_tablet_manager.cc:1905] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:41.254763 30645 ts_tablet_manager.cc:1905] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:41.189494 29564 raft_consensus.cc:2932] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:41.300892 30648 ts_tablet_manager.cc:1918] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:41.301728 30648 log.cc:1196] T 2fe1df4603dd4ecdad74103a84926118 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/2fe1df4603dd4ecdad74103a84926118
I20260807 15:09:41.307775 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet 2fe1df4603dd4ecdad74103a84926118 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:41.309882 30645 ts_tablet_manager.cc:1918] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:41.310648 30645 log.cc:1196] T 4db6cf72c3b74ea19f67f0d479e0b364 P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/4db6cf72c3b74ea19f67f0d479e0b364
I20260807 15:09:41.312512 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet 4db6cf72c3b74ea19f67f0d479e0b364 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:42.317909 29486 consensus_queue.cc:237] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:42.324771 29642 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 15:09:42.325232 29452 consensus_peers.cc:487] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00c48154e8c94a9c83e606db06e22092. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:42.325284 29567 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:42.326284 30554 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:42.327620 30650 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:42.340512 30650 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.347293 29567 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.345189 29642 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.366978 29379 catalog_manager.cc:5495] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:42.401850 29642 consensus_queue.cc:237] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:09:42.428550 29609 consensus_peers.cc:487] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a11f5d18a564611b87fe4b67e592ed8. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:42.428803 29567 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:42.430109 30609 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:42.430402 29486 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:42.431802 30640 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:42.456260 30609 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.458089 29486 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.470585 29570 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.478992 29642 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:42.494165 29377 catalog_manager.cc:5495] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
W20260807 15:09:42.533169 29609 consensus_peers.cc:487] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3d1cf6540694063929e5d2508204bd1. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:42.538439 29480 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:42.539973 30611 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:42.538715 29570 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:42.542505 30666 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:42.549391 30611 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.552079 29480 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.559823 29567 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.570942 29377 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.571614 29642 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:09:42.579730 29609 consensus_peers.cc:487] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1b28d0b706f4cacbfda48dd13e4d700. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:42.581578 29480 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:42.583016 30611 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:42.583088 29567 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:42.586571 30611 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:42.593575 30640 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.595450 29480 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.597249 29567 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:42.613126 29379 catalog_manager.cc:5495] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:42.845719 30674 ts_tablet_manager.cc:927] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:42.850823 30674 tablet_copy_client.cc:316] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:42.852577 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet 6a11f5d18a564611b87fe4b67e592ed8 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:42.853112 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet 6a11f5d18a564611b87fe4b67e592ed8 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-6a11f5d18a564611b87fe4b67e592ed8
I20260807 15:09:42.859256 29658 tablet_copy_source_session.cc:205] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:42.862124 30674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a11f5d18a564611b87fe4b67e592ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:42.876590 30674 tablet_copy_client.cc:791] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:42.877290 30674 tablet_copy_client.cc:655] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:42.881091 30674 tablet_copy_client.cc:531] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:42.890326 30674 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:42.903671 30676 ts_tablet_manager.cc:927] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:42.916145 30674 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:42.917371 30674 tablet_bootstrap.cc:492] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:42.918203 30676 tablet_copy_client.cc:316] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:42.919173 30674 ts_tablet_manager.cc:1397] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.029s user 0.023s sys 0.004s
I20260807 15:09:42.922277 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet 00c48154e8c94a9c83e606db06e22092 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:42.923507 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet 00c48154e8c94a9c83e606db06e22092 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-00c48154e8c94a9c83e606db06e22092
I20260807 15:09:42.928824 30674 raft_consensus.cc:348] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:42.929817 30674 raft_consensus.cc:729] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:42.930507 30674 consensus_queue.cc:260] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:42.941835 29498 tablet_copy_source_session.cc:205] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:42.951447 30676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c48154e8c94a9c83e606db06e22092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:42.967718 30674 ts_tablet_manager.cc:1428] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.048s user 0.013s sys 0.020s
I20260807 15:09:42.973970 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-6a11f5d18a564611b87fe4b67e592ed8 received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:42.974440 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-6a11f5d18a564611b87fe4b67e592ed8 on tablet 6a11f5d18a564611b87fe4b67e592ed8 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:42.975672 30676 tablet_copy_client.cc:791] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:42.976344 30676 tablet_copy_client.cc:655] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:42.989074 30676 tablet_copy_client.cc:531] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:42.998060 30676 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:43.020197 30676 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:43.021044 30676 tablet_bootstrap.cc:492] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:43.021624 30676 ts_tablet_manager.cc:1397] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.008s
I20260807 15:09:43.024142 30676 raft_consensus.cc:348] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:43.025055 30676 raft_consensus.cc:729] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:43.026114 30676 consensus_queue.cc:260] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:43.029345 30676 ts_tablet_manager.cc:1428] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260807 15:09:43.030880 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-00c48154e8c94a9c83e606db06e22092 received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:43.031248 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-00c48154e8c94a9c83e606db06e22092 on tablet 00c48154e8c94a9c83e606db06e22092 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:43.098513 30676 ts_tablet_manager.cc:927] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:43.100159 30676 tablet_copy_client.cc:316] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:43.101545 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet c3d1cf6540694063929e5d2508204bd1 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:43.102120 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet c3d1cf6540694063929e5d2508204bd1 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-c3d1cf6540694063929e5d2508204bd1
I20260807 15:09:43.111950 29658 tablet_copy_source_session.cc:205] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:43.114961 30676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3d1cf6540694063929e5d2508204bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:43.132006 30676 tablet_copy_client.cc:791] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:43.132735 30676 tablet_copy_client.cc:655] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:43.137676 30676 tablet_copy_client.cc:531] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:43.146498 30674 ts_tablet_manager.cc:927] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:43.147244 30676 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:43.173498 30674 tablet_copy_client.cc:316] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:43.176124 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet e1b28d0b706f4cacbfda48dd13e4d700 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:43.176887 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet e1b28d0b706f4cacbfda48dd13e4d700 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-e1b28d0b706f4cacbfda48dd13e4d700
I20260807 15:09:43.187487 30676 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:43.187986 29658 tablet_copy_source_session.cc:205] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:43.190843 30676 tablet_bootstrap.cc:492] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:43.191944 30676 ts_tablet_manager.cc:1397] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.045s user 0.020s sys 0.016s
I20260807 15:09:43.193708 30674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1b28d0b706f4cacbfda48dd13e4d700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:43.194892 30676 raft_consensus.cc:348] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:43.195664 30676 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:43.196446 30676 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:43.198355 30676 ts_tablet_manager.cc:1428] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:09:43.200356 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-c3d1cf6540694063929e5d2508204bd1 received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:43.200702 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-c3d1cf6540694063929e5d2508204bd1 on tablet c3d1cf6540694063929e5d2508204bd1 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:43.217696 30674 tablet_copy_client.cc:791] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:43.218348 30674 tablet_copy_client.cc:655] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:43.222239 30674 tablet_copy_client.cc:531] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:43.230343 30674 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:43.273341 30674 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:43.274441 30674 tablet_bootstrap.cc:492] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:43.276464 30674 ts_tablet_manager.cc:1397] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.046s user 0.022s sys 0.003s
I20260807 15:09:43.280391 30311 raft_consensus.cc:1203] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:43.293185 30674 raft_consensus.cc:348] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:43.294008 30674 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:43.294574 30674 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:43.306958 30311 raft_consensus.cc:1203] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:43.307979 30674 ts_tablet_manager.cc:1428] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260807 15:09:43.310070 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-e1b28d0b706f4cacbfda48dd13e4d700 received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:43.310456 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-e1b28d0b706f4cacbfda48dd13e4d700 on tablet e1b28d0b706f4cacbfda48dd13e4d700 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:43.549193 30312 raft_consensus.cc:1203] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:43.682385 30685 raft_consensus.cc:1050] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:43.684983 30685 consensus_queue.cc:237] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:43.692440 30311 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:43.692556 29646 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:43.694058 30688 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:43.695091 30689 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:43.700160 29570 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:43.703271 30689 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:43.711522 30688 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:43.743587 30311 raft_consensus.cc:1203] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:43.759986 29570 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:43.757460 30311 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:43.770514 29646 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:43.782956 29379 catalog_manager.cc:5495] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:43.811700 30687 raft_consensus.cc:1050] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:43.814992 30687 consensus_queue.cc:237] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:43.836274 29570 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:43.836617 30311 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:43.839699 29487 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:43.838112 30687 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 15:09:43.840750 30611 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:43.841955 30609 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:43.952786 29480 consensus_queue.cc:237] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:43.967935 30312 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:43.983695 30658 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:43.994594 29570 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:44.007659 30707 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.012426 29487 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.045107 30688 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.046041 30689 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:44.058053 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 00c48154e8c94a9c83e606db06e22092 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:44.057943 30312 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.062454 29567 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.070397 29566 raft_consensus.cc:2932] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.079219 29380 catalog_manager.cc:5495] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:44.080363 29377 catalog_manager.cc:5495] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.083081 30312 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.086601 30707 raft_consensus.cc:1050] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:44.107973 30707 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:44.152331 29570 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:44.158342 30312 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:44.161093 29487 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:44.165205 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet 00c48154e8c94a9c83e606db06e22092 with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:44.165472 30687 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:44.167521 30712 tablet_replica.cc:330] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:09:44.168699 30712 raft_consensus.cc:2229] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:44.169582 30712 raft_consensus.cc:2258] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:44.170647 29643 consensus_queue.cc:237] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:44.174610 30712 ts_tablet_manager.cc:1905] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:44.177973 29566 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:44.179189 30687 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:44.179684 30707 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:44.184297 30687 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:44.185647 30312 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:44.194289 30703 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.205797 30712 ts_tablet_manager.cc:1918] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:44.206405 30712 log.cc:1196] T 00c48154e8c94a9c83e606db06e22092 P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/00c48154e8c94a9c83e606db06e22092
I20260807 15:09:44.207302 29570 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.212467 30706 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:44.212037 30707 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.214239 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6a11f5d18a564611b87fe4b67e592ed8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:44.214365 29377 catalog_manager.cc:5495] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:44.217276 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet 00c48154e8c94a9c83e606db06e22092 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:44.219978 29480 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.224947 29567 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.227792 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a11f5d18a564611b87fe4b67e592ed8 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:09:44.235378 30309 raft_consensus.cc:2932] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.241684 29377 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:44.243253 30312 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.255784 30706 raft_consensus.cc:1050] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:44.269098 30706 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:44.280208 30716 tablet_replica.cc:330] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:09:44.280061 29643 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:44.281422 30716 raft_consensus.cc:2229] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:44.282234 30716 raft_consensus.cc:2258] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:44.287322 30312 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:44.296231 30704 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:44.290995 29480 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:44.302196 30704 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:44.299268 30716 ts_tablet_manager.cc:1905] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:44.307787 29567 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:44.310009 30687 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:44.320043 30312 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:44.321404 29486 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:44.322018 30716 ts_tablet_manager.cc:1918] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:44.322544 30716 log.cc:1196] T 6a11f5d18a564611b87fe4b67e592ed8 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/6a11f5d18a564611b87fe4b67e592ed8
I20260807 15:09:44.324622 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet 6a11f5d18a564611b87fe4b67e592ed8 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:44.329255 30687 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.332296 30704 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:44.334152 30312 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.335318 30707 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:44.339982 29486 raft_consensus.cc:2932] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.351279 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c3d1cf6540694063929e5d2508204bd1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:44.360847 29378 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:44.389272 30703 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.392138 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet c3d1cf6540694063929e5d2508204bd1 with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:09:44.398200 30312 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.420810 30722 tablet_replica.cc:330] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:09:44.423138 30722 raft_consensus.cc:2229] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:44.424610 30722 raft_consensus.cc:2258] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:44.426716 29382 catalog_manager.cc:5495] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.430176 29487 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.464303 30722 ts_tablet_manager.cc:1905] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:44.473114 29570 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.498574 30722 ts_tablet_manager.cc:1918] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:44.499501 30722 log.cc:1196] T c3d1cf6540694063929e5d2508204bd1 P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/c3d1cf6540694063929e5d2508204bd1
I20260807 15:09:44.502386 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet c3d1cf6540694063929e5d2508204bd1 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:44.519374 29643 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:44.526495 29480 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:44.529057 30309 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:44.530076 30703 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260807 15:09:44.540702 30704 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:44.546187 30707 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.562808 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e1b28d0b706f4cacbfda48dd13e4d700 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:44.564847 29487 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.588106 30309 raft_consensus.cc:2932] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.591971 29382 catalog_manager.cc:5495] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:44.611105 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet e1b28d0b706f4cacbfda48dd13e4d700 with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:09:44.612668 30722 tablet_replica.cc:330] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:09:44.614599 30722 raft_consensus.cc:2229] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:44.615727 30722 raft_consensus.cc:2258] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:44.627159 30722 ts_tablet_manager.cc:1905] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:44.654088 30722 ts_tablet_manager.cc:1918] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:44.654634 30722 log.cc:1196] T e1b28d0b706f4cacbfda48dd13e4d700 P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/e1b28d0b706f4cacbfda48dd13e4d700
I20260807 15:09:44.657485 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet e1b28d0b706f4cacbfda48dd13e4d700 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:45.700138 29643 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:45.708140 29566 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:45.708849 29480 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 15:09:45.709309 29609 consensus_peers.cc:487] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b67938f915c84df3a2da7adba02b898b. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:45.709746 30707 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:45.711223 30706 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:45.723994 30687 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.736634 29566 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.736909 29480 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.765448 29378 catalog_manager.cc:5495] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.789829 29566 consensus_queue.cc:237] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:09:45.801424 29533 consensus_peers.cc:487] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4c7484fae4742a2a93ad8d15ee4241c. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:45.802856 29643 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:45.803543 29480 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:45.804308 30723 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:45.808876 30708 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:45.821287 30708 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.827106 29642 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.832666 29480 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.842422 29486 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:45.852277 29382 catalog_manager.cc:5495] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260807 15:09:45.861114 29452 consensus_peers.cc:487] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29795442e1dd46f3becb9daf1bd74aef. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:45.861598 29642 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:45.862963 30725 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:45.863306 29566 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:45.864886 30710 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:45.880524 30725 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.884634 29567 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.899154 29570 consensus_queue.cc:237] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:45.901332 29642 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.921741 29377 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:45.924424 29647 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 15:09:45.927736 29533 consensus_peers.cc:487] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b21bbc939b9464c8729e18e5401dd65. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:45.930940 30744 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:45.943377 29480 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:45.945585 30723 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:45.953845 29487 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.957480 30744 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.966219 29647 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:45.988950 29377 catalog_manager.cc:5495] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:46.263782 30749 ts_tablet_manager.cc:927] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:46.266113 30749 tablet_copy_client.cc:316] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:46.267792 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet b67938f915c84df3a2da7adba02b898b from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:46.268394 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet b67938f915c84df3a2da7adba02b898b from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-b67938f915c84df3a2da7adba02b898b
I20260807 15:09:46.277459 29658 tablet_copy_source_session.cc:205] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:46.281648 30749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b67938f915c84df3a2da7adba02b898b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:46.298990 30749 tablet_copy_client.cc:791] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:46.299602 30749 tablet_copy_client.cc:655] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:46.303463 30749 tablet_copy_client.cc:531] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:46.312711 30749 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:46.338146 30749 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:46.339061 30749 tablet_bootstrap.cc:492] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:46.339713 30749 ts_tablet_manager.cc:1397] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.008s
I20260807 15:09:46.342437 30749 raft_consensus.cc:348] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:46.343302 30749 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:46.344012 30749 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:46.351636 30755 ts_tablet_manager.cc:927] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:46.355878 30753 ts_tablet_manager.cc:927] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:46.380470 30755 tablet_copy_client.cc:316] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:09:46.386659 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet f4c7484fae4742a2a93ad8d15ee4241c from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:09:46.387451 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet f4c7484fae4742a2a93ad8d15ee4241c from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-f4c7484fae4742a2a93ad8d15ee4241c
I20260807 15:09:46.396530 30753 tablet_copy_client.cc:316] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:46.398293 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet 29795442e1dd46f3becb9daf1bd74aef from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:46.398914 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet 29795442e1dd46f3becb9daf1bd74aef from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-29795442e1dd46f3becb9daf1bd74aef
I20260807 15:09:46.403280 30749 ts_tablet_manager.cc:1428] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.063s user 0.015s sys 0.026s
I20260807 15:09:46.407284 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-b67938f915c84df3a2da7adba02b898b received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:46.407810 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-b67938f915c84df3a2da7adba02b898b on tablet b67938f915c84df3a2da7adba02b898b with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:46.407339 29498 tablet_copy_source_session.cc:205] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:46.408507 29579 tablet_copy_source_session.cc:205] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:46.412964 30755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4c7484fae4742a2a93ad8d15ee4241c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:46.417378 30753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29795442e1dd46f3becb9daf1bd74aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:46.428586 30755 tablet_copy_client.cc:791] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:46.429157 30755 tablet_copy_client.cc:655] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:46.433389 30755 tablet_copy_client.cc:531] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:46.436239 30753 tablet_copy_client.cc:791] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:46.436895 30753 tablet_copy_client.cc:655] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:46.441504 30749 ts_tablet_manager.cc:927] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:46.441696 30755 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:46.444154 30749 tablet_copy_client.cc:316] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:09:46.446307 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 9b21bbc939b9464c8729e18e5401dd65 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:09:46.446877 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 9b21bbc939b9464c8729e18e5401dd65 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-9b21bbc939b9464c8729e18e5401dd65
I20260807 15:09:46.454535 30753 tablet_copy_client.cc:531] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:46.466043 30753 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:46.467530 29579 tablet_copy_source_session.cc:205] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:46.472126 30749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b21bbc939b9464c8729e18e5401dd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:46.491367 30755 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:46.492377 30755 tablet_bootstrap.cc:492] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:46.493093 30755 ts_tablet_manager.cc:1397] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.052s user 0.020s sys 0.010s
I20260807 15:09:46.496680 30755 raft_consensus.cc:348] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:46.497557 30755 raft_consensus.cc:729] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:46.498271 30755 consensus_queue.cc:260] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:46.503458 30755 ts_tablet_manager.cc:1428] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260807 15:09:46.507143 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-f4c7484fae4742a2a93ad8d15ee4241c received from {username='slave'} at 127.0.0.1:60682
I20260807 15:09:46.507551 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-f4c7484fae4742a2a93ad8d15ee4241c on tablet f4c7484fae4742a2a93ad8d15ee4241c with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:46.521068 30749 tablet_copy_client.cc:791] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:46.521905 30749 tablet_copy_client.cc:655] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:46.533479 30749 tablet_copy_client.cc:531] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:46.534983 30753 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:46.536006 30753 tablet_bootstrap.cc:492] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:46.536800 30753 ts_tablet_manager.cc:1397] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.071s user 0.040s sys 0.011s
I20260807 15:09:46.539585 30753 raft_consensus.cc:348] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:46.540441 30753 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:46.541086 30753 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:46.543618 30753 ts_tablet_manager.cc:1428] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20260807 15:09:46.546701 30749 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:46.549134 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-29795442e1dd46f3becb9daf1bd74aef received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:46.549572 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-29795442e1dd46f3becb9daf1bd74aef on tablet 29795442e1dd46f3becb9daf1bd74aef with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:46.581744 30749 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:46.582705 30749 tablet_bootstrap.cc:492] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:46.583483 30749 ts_tablet_manager.cc:1397] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.037s user 0.020s sys 0.011s
I20260807 15:09:46.586222 30749 raft_consensus.cc:348] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:46.587062 30749 raft_consensus.cc:729] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:46.587705 30749 consensus_queue.cc:260] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:46.589883 30749 ts_tablet_manager.cc:1428] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260807 15:09:46.592321 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-9b21bbc939b9464c8729e18e5401dd65 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:09:46.592767 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-9b21bbc939b9464c8729e18e5401dd65 on tablet 9b21bbc939b9464c8729e18e5401dd65 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:46.706418 30309 raft_consensus.cc:1203] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:46.733676 30309 raft_consensus.cc:1203] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:46.831876 30309 raft_consensus.cc:1203] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:46.931373 30309 raft_consensus.cc:1203] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:47.256251 30723 raft_consensus.cc:1050] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:47.258374 30723 consensus_queue.cc:237] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:47.264328 30745 raft_consensus.cc:1050] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:47.267249 29647 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.267457 30745 consensus_queue.cc:237] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:47.269695 30708 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:47.275002 30309 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.277882 29487 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.281020 30723 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:47.282768 30723 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:47.296743 30309 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.297932 29480 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.298237 30764 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:47.305476 29643 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.306489 30764 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:47.307713 30745 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.309540 30764 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:47.318480 30730 raft_consensus.cc:1050] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:47.323700 30730 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:47.323406 30309 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.407532 29377 catalog_manager.cc:5495] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:09:47.413884 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 52525.2us
I20260807 15:09:47.416535 29642 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:09:47.435927 30767 log.cc:924] Time spent T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.098s user 0.001s sys 0.000s
W20260807 15:09:47.523216 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 90096.1us
I20260807 15:09:47.529402 29567 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.530150 30309 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.534873 30779 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:47.539559 29487 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.552424 30775 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:47.564615 30730 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:47.593788 30725 raft_consensus.cc:1050] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:47.589010 30789 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.603572 29483 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.609611 30731 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.614445 29486 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.617314 29480 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.625783 30725 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:47.627322 30309 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.646410 30312 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.646498 29647 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.648185 30781 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:47.658046 29642 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.659600 30787 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:47.670914 30309 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.688482 29566 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.689110 30787 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.697630 29647 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.700814 29566 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:47.703665 30784 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:47.713210 30310 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.728580 29570 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.735189 29380 catalog_manager.cc:5495] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:47.737886 29380 catalog_manager.cc:5495] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.758391 29568 consensus_queue.cc:237] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:47.755165 29378 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:47.764189 29567 consensus_queue.cc:237] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:47.765538 29647 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:47.767102 30789 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:47.771916 30310 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:47.776613 30790 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:47.781325 30310 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:47.782888 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:47.782099 30780 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.785279 29647 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.789889 29643 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:47.792837 29480 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:47.801040 30309 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:47.803402 30309 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:47.803542 29643 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:47.805685 30784 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:47.806505 30787 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:47.808944 29567 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:47.811450 30731 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:09:47.814472 30785 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:47.819383 30312 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.820958 30784 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.822683 30731 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.826855 30309 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.841341 29480 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:47.830919 29643 raft_consensus.cc:2932] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.832758 29568 raft_consensus.cc:2932] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.842798 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 9b21bbc939b9464c8729e18e5401dd65 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:47.848404 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 29795442e1dd46f3becb9daf1bd74aef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:47.851389 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet b67938f915c84df3a2da7adba02b898b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:47.846689 29377 catalog_manager.cc:5495] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.860987 30789 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:47.869961 30789 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:47.852412 29382 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.876235 30312 raft_consensus.cc:2932] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.887229 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b21bbc939b9464c8729e18e5401dd65 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:09:47.896283 30803 tablet_replica.cc:330] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:09:47.896065 30786 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.907585 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f4c7484fae4742a2a93ad8d15ee4241c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:47.908968 30312 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.909797 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet 29795442e1dd46f3becb9daf1bd74aef with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:09:47.910871 29483 raft_consensus.cc:2932] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.912532 30804 tablet_replica.cc:330] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:09:47.915377 30804 raft_consensus.cc:2229] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:47.916483 30804 raft_consensus.cc:2258] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:47.928704 29377 catalog_manager.cc:5495] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:47.932864 30804 ts_tablet_manager.cc:1905] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:47.935858 30803 raft_consensus.cc:2229] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:47.936818 30803 raft_consensus.cc:2258] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:47.947728 30803 ts_tablet_manager.cc:1905] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:47.962847 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet b67938f915c84df3a2da7adba02b898b with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:09:47.970911 30803 ts_tablet_manager.cc:1918] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:47.973249 30803 log.cc:1196] T 9b21bbc939b9464c8729e18e5401dd65 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/9b21bbc939b9464c8729e18e5401dd65
I20260807 15:09:47.977990 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet 9b21bbc939b9464c8729e18e5401dd65 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:47.978480 30803 tablet_replica.cc:330] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:09:47.980875 30803 raft_consensus.cc:2229] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:47.981938 30803 raft_consensus.cc:2258] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:47.973224 29378 catalog_manager.cc:5495] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:47.990247 30803 ts_tablet_manager.cc:1905] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:47.998893 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet f4c7484fae4742a2a93ad8d15ee4241c with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:48.005214 30804 ts_tablet_manager.cc:1918] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:48.006297 30804 log.cc:1196] T 29795442e1dd46f3becb9daf1bd74aef P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/29795442e1dd46f3becb9daf1bd74aef
I20260807 15:09:48.023865 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet 29795442e1dd46f3becb9daf1bd74aef (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:48.028115 30805 tablet_replica.cc:330] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:09:48.030474 30805 raft_consensus.cc:2229] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:48.032089 30805 raft_consensus.cc:2258] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:48.037989 30805 ts_tablet_manager.cc:1905] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:48.039335 30803 ts_tablet_manager.cc:1918] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:48.040124 30803 log.cc:1196] T b67938f915c84df3a2da7adba02b898b P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/b67938f915c84df3a2da7adba02b898b
I20260807 15:09:48.042877 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet b67938f915c84df3a2da7adba02b898b (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:48.091320 30805 ts_tablet_manager.cc:1918] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:48.091938 30805 log.cc:1196] T f4c7484fae4742a2a93ad8d15ee4241c P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/f4c7484fae4742a2a93ad8d15ee4241c
I20260807 15:09:48.091686 29483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:09:48.092664 29483 raft_consensus.cc:595] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:09:48.093848 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet f4c7484fae4742a2a93ad8d15ee4241c (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:48.115486 29643 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:48.116266 29643 raft_consensus.cc:595] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:48.119021 29643 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:48.119562 29643 raft_consensus.cc:595] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:48.122115 29643 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:48.122648 29643 raft_consensus.cc:595] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:48.127211 29643 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:48.127838 29643 raft_consensus.cc:595] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:48.151494 30730 raft_consensus.cc:979] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:48.152413 30730 raft_consensus.cc:1067] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:48.155068 29568 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:09:48.156433 29568 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:48.156755 29568 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.156723 29567 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:48.157516 29567 raft_consensus.cc:595] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:09:48.158986 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260807 15:09:48.160929 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:48.161737 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:48.164570 29568 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.166808 29568 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:48.168365 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:48.169121 29480 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.178268 29480 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:48.179571 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:48.181658 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:48.182425 29643 raft_consensus.cc:3032] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:48.182883 29643 raft_consensus.cc:729] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:48.181715 30789 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:48.183663 29643 consensus_queue.cc:260] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.185225 29643 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.185797 30789 raft_consensus.cc:686] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:48.187641 30789 consensus_queue.cc:237] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.193766 29643 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:48.207252 29377 catalog_manager.cc:5495] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:48.376111 30785 raft_consensus.cc:979] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:48.376869 30785 raft_consensus.cc:1067] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:48.378870 29568 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:09:48.379483 29568 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:48.379976 29568 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.387286 29568 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.388870 29568 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:48.389421 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:48.390049 29486 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.390061 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:48.390929 29643 raft_consensus.cc:3032] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:48.391222 29643 raft_consensus.cc:729] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:48.391981 29643 consensus_queue.cc:260] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.393009 29643 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.396212 29486 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:48.397393 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:48.398124 30790 raft_consensus.cc:2781] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:48.398592 30790 raft_consensus.cc:686] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:48.399498 30790 consensus_queue.cc:237] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.400892 29643 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:48.410356 29377 catalog_manager.cc:5495] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:48.446619 30790 raft_consensus.cc:979] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:48.447187 30780 raft_consensus.cc:1067] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:48.448689 30309 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48584
I20260807 15:09:48.449199 30309 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:48.449510 30309 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.454815 30309 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:48.457046 30309 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:48.457695 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:48.457729 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:48.458396 29568 raft_consensus.cc:3032] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:48.458472 29643 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.458801 29568 raft_consensus.cc:729] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:48.459601 29568 consensus_queue.cc:260] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:48.460587 29568 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.464260 29643 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:48.466168 30272 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:48.467356 29568 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:48.468083 30814 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:48.469762 30814 raft_consensus.cc:686] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:48.470968 30814 consensus_queue.cc:237] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:48.481374 29377 catalog_manager.cc:5495] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:48.501494 30730 raft_consensus.cc:979] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:48.501976 30785 raft_consensus.cc:1067] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:48.503439 29568 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:09:48.503949 29568 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:48.504185 29568 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.508723 29568 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.510232 29568 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:48.511059 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:48.511369 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:48.511765 29486 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.511970 29643 raft_consensus.cc:3032] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:48.512336 29643 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:48.513017 29643 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.514266 29643 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.518735 29486 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:48.519917 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:48.520705 30780 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:48.520866 29643 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:48.521209 30785 raft_consensus.cc:979] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:48.521371 30780 raft_consensus.cc:686] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:48.521798 30785 raft_consensus.cc:1067] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:48.523056 30780 consensus_queue.cc:237] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.525355 29568 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:09:48.525964 29568 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:48.526278 29568 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.532872 29568 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.535225 29568 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:48.536268 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:48.536818 29643 raft_consensus.cc:3032] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:48.537029 29643 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:48.537801 29643 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.538826 29643 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.569446 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:48.571624 29486 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.572517 29377 catalog_manager.cc:5495] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:48.592716 30784 raft_consensus.cc:979] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:48.593642 30784 raft_consensus.cc:1067] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:48.596791 30312 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:39994
I20260807 15:09:48.597609 30312 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:48.598172 30312 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.600293 29643 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:48.606606 29486 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:48.611173 29531 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:48.611581 30312 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:48.613737 30780 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:48.615518 30780 raft_consensus.cc:686] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:48.615186 30312 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:48.616724 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:48.617524 29480 raft_consensus.cc:3032] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:48.617887 29480 raft_consensus.cc:729] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:48.618999 29480 consensus_queue.cc:260] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:48.617204 30780 consensus_queue.cc:237] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:48.621670 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:48.630575 29568 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.637735 29480 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:48.649495 29568 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:48.651829 30273 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:48.652279 29480 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:48.653193 30814 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:48.653743 30814 raft_consensus.cc:686] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:48.655083 30814 consensus_queue.cc:237] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:48.659179 29377 catalog_manager.cc:5495] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:48.669986 29382 catalog_manager.cc:5495] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:48.740801 29643 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:48.742300 30789 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:48.768669 29483 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:48.771179 30790 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:48.831012 29483 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:48.832299 30780 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:48.844282 29643 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:48.846076 30789 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:48.918475 29643 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:48.919842 30814 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:48.931558 29567 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:48.937944 30814 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:09:48.995602 29481 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:48.996868 30789 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:49.011701 29643 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:49.013710 30780 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:49.056031 29643 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:49.057770 30780 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:49.074311 29481 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:49.076462 29483 consensus_queue.cc:237] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:49.083709 30790 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 15:09:49.112185 29452 consensus_peers.cc:487] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1d288f694924e79826a10fc7cff8351. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:49.114435 29568 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 15:09:49.114594 29642 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 15:09:49.117018 30776 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:49.121848 30784 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:49.131461 30776 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.133080 29568 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.136656 29643 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.143105 29483 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:49.147431 30814 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:09:49.157936 29480 consensus_queue.cc:237] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:49.151212 29378 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 2 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.160724 29568 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:49.161983 30814 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 15:09:49.199985 29452 consensus_peers.cc:487] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afaa655e923f4aecbeee1b026c46810e. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:49.200130 29567 raft_consensus.cc:1261] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:49.202013 30776 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:49.203112 29643 raft_consensus.cc:1261] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:49.204820 30725 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:49.214103 30725 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.217567 29642 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.238881 29382 catalog_manager.cc:5495] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.249290 29643 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:49.252324 29567 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.263077 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:49.284309 29480 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:49.284929 29568 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 15:09:49.285238 29609 consensus_peers.cc:487] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: acc305388a594a0f8be8d24006e0b323. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:49.287856 30785 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:49.290467 30774 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:49.304479 30731 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.311693 29483 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.323096 29567 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:49.323779 29567 raft_consensus.cc:595] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:49.323973 29566 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.331043 29567 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:49.331667 29567 raft_consensus.cc:595] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:09:49.335089 29378 catalog_manager.cc:5495] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.341499 29483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c10b42b2212f45838c83e394b00482df"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:09:49.344277 29486 consensus_queue.cc:237] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:49.342208 29483 raft_consensus.cc:595] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:09:49.361358 29566 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:49.362035 29566 raft_consensus.cc:595] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:09:49.365077 29567 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:49.365731 29567 raft_consensus.cc:595] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:09:49.369086 29642 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:49.369704 29642 raft_consensus.cc:595] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:09:49.371627 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260807 15:09:49.373335 29452 consensus_peers.cc:487] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f07d982710354dfca721e4641d589839. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:49.373575 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:49.374902 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:49.376032 30785 raft_consensus.cc:979] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.376508 29642 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:49.376617 30774 raft_consensus.cc:1067] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.378572 30309 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48588
I20260807 15:09:49.378439 30776 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:49.378957 29567 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:49.379149 30309 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:49.379591 30309 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.380744 30725 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:49.388171 30309 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.394376 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:49.395079 29644 raft_consensus.cc:3032] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:49.395393 29644 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:49.396250 29644 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.397560 29644 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.397698 30837 raft_consensus.cc:979] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.398557 30784 raft_consensus.cc:1067] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.400628 30312 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c10b42b2212f45838c83e394b00482df"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:39994
I20260807 15:09:49.401336 30312 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:49.401757 30312 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.404209 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:49.404983 29566 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.424976 29566 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.429486 30273 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:49.430842 30814 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:49.431504 30814 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:49.433182 30814 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.427506 29644 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.428973 30309 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:49.445371 30784 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.447063 29568 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.459817 30312 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.465945 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:49.466743 29486 raft_consensus.cc:3032] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:49.467087 29486 raft_consensus.cc:729] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:49.467994 29486 consensus_queue.cc:260] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.467432 29377 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:49.469395 29486 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.478248 29382 catalog_manager.cc:5495] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.480352 30312 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:49.483515 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:49.484529 29644 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.488180 29642 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:49.495343 29644 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.498252 30272 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:49.499568 30814 raft_consensus.cc:2781] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:49.500124 30814 raft_consensus.cc:686] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:49.501096 30814 consensus_queue.cc:237] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.513432 29486 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.522379 30790 raft_consensus.cc:979] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.522903 30790 raft_consensus.cc:1067] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.522900 29377 catalog_manager.cc:5495] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:49.524793 30312 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48584
I20260807 15:09:49.525318 30312 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:49.525630 30312 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.530694 30312 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.533736 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:49.534332 29568 raft_consensus.cc:3032] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:49.534622 29568 raft_consensus.cc:729] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:49.535326 29568 consensus_queue.cc:260] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.536481 29568 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.536702 30312 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:49.537513 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:49.538707 29486 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.547453 29486 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.548935 30274 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:49.547539 29568 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.549937 30814 raft_consensus.cc:2781] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:49.550413 30814 raft_consensus.cc:686] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:49.551285 30814 consensus_queue.cc:237] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.555190 30832 raft_consensus.cc:979] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:09:49.555720 30832 raft_consensus.cc:1067] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:09:49.557621 29480 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:09:49.558148 29480 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:49.558493 29480 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:49.562203 29378 catalog_manager.cc:5495] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:49.580210 29480 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:49.583951 29480 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:49.584292 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:49.584992 29647 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:49.583833 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:49.585522 29568 raft_consensus.cc:3032] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:49.585862 29568 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:49.586522 29568 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:49.587713 29568 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:49.593092 29647 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:09:49.595682 29449 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:49.596319 29568 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:09:49.596483 30784 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:49.597035 30784 raft_consensus.cc:686] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:49.597831 30784 consensus_queue.cc:237] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:49.606559 30857 ts_tablet_manager.cc:927] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:49.631762 29378 catalog_manager.cc:5495] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:49.656605 30857 tablet_copy_client.cc:316] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:49.658612 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet afaa655e923f4aecbeee1b026c46810e from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:49.659227 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet afaa655e923f4aecbeee1b026c46810e from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-afaa655e923f4aecbeee1b026c46810e
I20260807 15:09:49.668959 29498 tablet_copy_source_session.cc:205] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:49.672508 30857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afaa655e923f4aecbeee1b026c46810e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:49.689954 30790 raft_consensus.cc:979] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.690608 30780 raft_consensus.cc:1067] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.691931 30857 tablet_copy_client.cc:791] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:49.692126 30312 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48584
I20260807 15:09:49.692687 30857 tablet_copy_client.cc:655] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:49.692759 30312 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:49.693224 30312 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.699146 30857 tablet_copy_client.cc:531] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:49.699545 30312 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.702172 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:49.702749 29487 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.702942 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:49.703560 29568 raft_consensus.cc:3032] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:49.703845 29568 raft_consensus.cc:729] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:49.704583 29568 consensus_queue.cc:260] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.705631 29568 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.708777 30857 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:49.709733 29487 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.711061 30274 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:49.712225 30814 raft_consensus.cc:2781] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:49.712699 30814 raft_consensus.cc:686] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:49.713591 30814 consensus_queue.cc:237] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.725890 29568 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.726847 30312 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:49.741281 30859 ts_tablet_manager.cc:927] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:49.763823 29378 catalog_manager.cc:5495] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 15:09:49.824469 30860 log.cc:924] Time spent T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.082s user 0.000s sys 0.001s
I20260807 15:09:49.807605 30790 raft_consensus.cc:979] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.830014 30790 raft_consensus.cc:1067] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:49.855836 30312 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48584
I20260807 15:09:49.856640 30312 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:49.857419 30312 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.859424 30859 tablet_copy_client.cc:316] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:49.871610 30312 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.876093 30864 ts_tablet_manager.cc:927] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:49.876287 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:49.878937 29647 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.879559 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:49.880438 29568 raft_consensus.cc:3032] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:49.880761 29568 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:49.881613 29568 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.882800 30857 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:49.882949 29568 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:49.884093 30857 tablet_bootstrap.cc:492] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:49.885094 30857 ts_tablet_manager.cc:1397] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.177s user 0.043s sys 0.026s
I20260807 15:09:49.887877 29647 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.889391 30272 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:49.889883 30857 raft_consensus.cc:348] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:49.891108 30857 raft_consensus.cc:729] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:49.891943 30857 consensus_queue.cc:260] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:49.893682 30842 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:49.894271 30842 raft_consensus.cc:686] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:49.894785 30857 ts_tablet_manager.cc:1428] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.009s user 0.005s sys 0.002s
I20260807 15:09:49.895180 29568 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:49.895295 30842 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:49.899569 30312 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:49.907640 29647 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:49.909857 30814 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:49.945827 30864 tablet_copy_client.cc:316] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:09:49.948024 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet acc305388a594a0f8be8d24006e0b323 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:09:49.948660 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet acc305388a594a0f8be8d24006e0b323 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-acc305388a594a0f8be8d24006e0b323
I20260807 15:09:49.958819 29658 tablet_copy_source_session.cc:205] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:49.963099 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet b1d288f694924e79826a10fc7cff8351 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:49.964591 29499 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-afaa655e923f4aecbeee1b026c46810e received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:49.965189 29499 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-afaa655e923f4aecbeee1b026c46810e on tablet afaa655e923f4aecbeee1b026c46810e with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:49.965111 29378 catalog_manager.cc:5495] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:49.966560 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet b1d288f694924e79826a10fc7cff8351 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-b1d288f694924e79826a10fc7cff8351
I20260807 15:09:49.981796 30864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc305388a594a0f8be8d24006e0b323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:49.983650 30857 ts_tablet_manager.cc:927] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:49.983856 29481 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:49.985781 29647 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:49.985481 30814 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:49.995697 30814 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:50.000929 29498 tablet_copy_source_session.cc:205] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:50.009738 30309 raft_consensus.cc:1203] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:50.727824 30859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d288f694924e79826a10fc7cff8351. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 15:09:50.756938 30864 consensus_meta.cc:287] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.710s user 0.013s sys 0.000s
I20260807 15:09:50.759153 30864 tablet_copy_client.cc:791] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:50.759858 30864 tablet_copy_client.cc:655] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:50.792336 29481 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:50.793977 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39994 (request call id 202) took 1081 ms. Trace:
I20260807 15:09:50.793836 30884 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:09:50.794490 30859 rpcz_store.cc:276] 0807 15:09:49.712901 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:49.713082 (+ 181us) service_pool.cc:227] Handling call
0807 15:09:49.741678 (+ 28596us) ts_tablet_manager.cc:928] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
0807 15:09:50.720578 (+978900us) tablet_copy_client.cc:361] Tablet copy session begun
0807 15:09:50.773967 (+ 53389us) tablet_metadata.cc:641] Metadata flushed
0807 15:09:50.774304 (+ 337us) tablet_copy_client.cc:490] Wrote new tablet metadata
0807 15:09:50.793057 (+ 18753us) tablet_copy_client.cc:411] Wrote new consensus metadata
0807 15:09:50.793441 (+ 384us) tablet_replica.cc:205] Creating consensus instance
0807 15:09:50.793842 (+ 401us) ts_tablet_manager.cc:983] Replica registered.
0807 15:09:50.793903 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":109863,"tablet-copy.queue_time_us":27413,"thread_start_us":31739,"threads_started":2}
I20260807 15:09:50.796142 30859 tablet_copy_client.cc:791] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:50.796847 30859 tablet_copy_client.cc:655] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:50.801047 30859 tablet_copy_client.cc:531] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:50.809976 30859 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:50.834800 29481 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:50.837468 30885 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:09:50.838179 30859 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:50.839708 30859 tablet_bootstrap.cc:492] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:50.840860 30859 ts_tablet_manager.cc:1397] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.011s
I20260807 15:09:50.843998 30859 raft_consensus.cc:348] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:50.845034 30859 raft_consensus.cc:729] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:50.845824 30859 consensus_queue.cc:260] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:50.848999 30859 ts_tablet_manager.cc:1428] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260807 15:09:50.850829 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-b1d288f694924e79826a10fc7cff8351 received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:50.851218 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-b1d288f694924e79826a10fc7cff8351 on tablet b1d288f694924e79826a10fc7cff8351 with peer fbf78964d70448269802ac7de9d7a198
W20260807 15:09:50.852934 29647 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s user 0.002s sys 0.020s
W20260807 15:09:50.853260 29647 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s user 0.002s sys 0.020s
W20260807 15:09:50.884145 30857 thread.cc:602] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.899s user 0.021s sys 0.017s
I20260807 15:09:50.884933 30857 tablet_copy_client.cc:316] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:09:50.886873 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet f07d982710354dfca721e4641d589839 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:09:50.887428 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet f07d982710354dfca721e4641d589839 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-f07d982710354dfca721e4641d589839
I20260807 15:09:50.898043 29498 tablet_copy_source_session.cc:205] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:50.908471 29570 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:50.909720 29564 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:50.910020 29568 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:50.912442 30857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f07d982710354dfca721e4641d589839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:09:50.921829 29567 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:50.925566 30881 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:09:50.926904 30842 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:09:50.928243 30842 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:09:50.933311 30885 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:09:51.013199 30892 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:51.019415 30903 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.026007 30903 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.027107 30892 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.004968 30814 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:09:51.015861 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 53527.1us
I20260807 15:09:51.030346 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.037961 30892 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.042500 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.043944 30903 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.029863 30814 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.051772 30842 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.052383 30842 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.059450 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.056082 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39994 (request call id 204) took 1089 ms. Trace:
I20260807 15:09:51.083746 30903 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.084481 30903 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.086601 30903 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.088197 30878 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:51.090999 30725 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.088779 30878 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.109928 30883 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.110556 30878 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.111243 30725 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.113647 30815 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.081030 30842 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.079110 30857 rpcz_store.cc:276] 0807 15:09:49.964914 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:49.965072 (+ 158us) service_pool.cc:227] Handling call
0807 15:09:49.984109 (+ 19037us) ts_tablet_manager.cc:928] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
0807 15:09:50.911229 (+927120us) tablet_copy_client.cc:361] Tablet copy session begun
0807 15:09:50.923948 (+ 12719us) tablet_metadata.cc:641] Metadata flushed
0807 15:09:50.924260 (+ 312us) tablet_copy_client.cc:490] Wrote new tablet metadata
0807 15:09:51.053187 (+128927us) tablet_copy_client.cc:411] Wrote new consensus metadata
0807 15:09:51.053613 (+ 426us) tablet_replica.cc:205] Creating consensus instance
0807 15:09:51.054085 (+ 472us) ts_tablet_manager.cc:983] Replica registered.
0807 15:09:51.054610 (+ 525us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":247,"tablet-copy.queue_time_us":18080,"thread_start_us":959308,"threads_started":2}
I20260807 15:09:51.115095 30857 tablet_copy_client.cc:791] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:09:51.115662 30857 tablet_copy_client.cc:655] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:09:51.117980 30814 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.111284 30878 raft_consensus.cc:1050] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:51.113729 30725 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.122018 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.114194 30815 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.133437 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.136449 30815 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.137974 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.145478 30912 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:09:51.145541 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.146767 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.143484 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:51.140264 30815 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.145160 30857 tablet_copy_client.cc:531] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:51.148408 30911 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.148787 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:51.148959 30911 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.150578 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:51.110558 30883 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.153420 30883 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.146154 30912 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.157336 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.162113 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.162295 30912 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.162146 30911 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.154665 30815 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.164842 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.165305 30815 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.166394 30905 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.167147 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:51.168340 30725 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.173134 30725 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.177477 30881 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:51.177896 30895 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:51.178614 30725 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.176221 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:51.169310 30784 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.191867 30784 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.177997 30881 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.166926 30905 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.193284 30725 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.166668 30878 consensus_queue.cc:237] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.169874 30883 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.193948 30725 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.197501 30881 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.185336 30895 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:51.204093 29531 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:51.221072 30908 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.199463 30903 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.209674 30883 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.221828 30908 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.244532 29531 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:51.286059 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:51.265153 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 98167.6us
I20260807 15:09:51.226969 30725 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.288156 30904 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.359400 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.222424 30874 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.283927 30884 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.382889 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.281095 30814 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.265993 30876 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.224224 30895 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:51.263588 30909 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:51.405443 30311 raft_consensus.cc:1203] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260807 15:09:51.316382 30905 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.316982 30881 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.409842 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.285501 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.316289 30903 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:51.419365 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 194933us
I20260807 15:09:51.417078 30885 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.443840 30915 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.401292 30904 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.444532 30915 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.482383 30915 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.411024 30884 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.485754 30884 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.479457 30904 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.411590 30874 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.495121 30874 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.443938 30905 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.447456 30784 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.438174 30895 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:51.446712 30842 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.407706 30814 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:09:51.506436 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 282672us
I20260807 15:09:51.502135 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.444270 30885 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.458756 30911 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.520656 30891 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.521489 30891 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.511149 29569 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
W20260807 15:09:51.502322 28232 debug-util.cc:398] Leaking SignalData structure 0x7b080000ed20 after lost signal to thread 29647
W20260807 15:09:51.495991 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08000fff40 after lost signal to thread 28230
I20260807 15:09:51.496325 30785 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:09:51.452515 30881 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.502238 30875 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.546703 30916 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:09:51.507232 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.447057 30876 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.557953 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:51.559217 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:51.564807 30919 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:09:51.508298 30905 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.573428 29561 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:51.531744 30842 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.445302 30909 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.577410 30917 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.578821 30881 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.581775 30883 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.526803 30911 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.566982 30837 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:51.598093 30814 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.576191 29560 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
W20260807 15:09:51.582791 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08001225e0 after lost signal to thread 29417
I20260807 15:09:51.619992 30725 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.620864 30725 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.621749 30909 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.623240 30725 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.626157 30725 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.586946 30891 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.631215 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.590430 30908 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.678812 30725 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.686239 30885 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.628304 30919 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.697568 30919 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.698305 30919 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.698987 30919 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.550316 30785 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.722492 30882 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.725281 30842 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.678067 30903 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.735936 30725 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:09:51.730674 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9da0 after lost signal to thread 29514
I20260807 15:09:51.741912 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.682521 30908 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.747644 29568 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:51.751050 30930 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.572214 30875 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:51.763383 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.571925 30916 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.745132 30876 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.782395 29531 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:51.782800 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.632337 30837 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.789196 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.789994 29566 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:51.790246 30837 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.677327 30917 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:51.793702 30917 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.760245 30776 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.822232 30916 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.825139 30916 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:51.825796 30916 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.763248 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.832374 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.833032 29481 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:51.831796 30932 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:09:51.833851 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 81119.4us
I20260807 15:09:51.757141 30908 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:51.829996 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8ca0 after lost signal to thread 29594
I20260807 15:09:51.777623 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.751698 30930 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:51.850728 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:51.857154 30273 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:09:51.857338 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 172463us
I20260807 15:09:51.857518 30725 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:51.857939 30725 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.858273 30725 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:51.858486 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.836880 30905 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.866590 29450 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:51.831439 30881 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:51.868307 30901 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:51.868739 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.870330 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.865576 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.872299 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.879076 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.833793 30776 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.881179 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.855772 30911 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.877785 30916 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.885672 30901 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:51.864162 30814 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260807 15:09:51.764403 30882 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:51.905586 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.908317 30901 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.875675 30881 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:51.908968 30936 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:51.909485 30936 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.910028 30936 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:09:51.902881 29511 debug-util.cc:398] Leaking SignalData structure 0x7b0800342600 after lost signal to thread 29674
I20260807 15:09:51.918550 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:51.839563 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:51.904268 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.920758 29481 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:51.921252 29483 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:09:51.922695 30882 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.923094 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.923934 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.924106 30785 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:51.859854 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.905668 30919 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.928711 30857 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:51.963415 30309 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:51.973948 29452 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:51.924623 30938 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.929637 30930 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:51.932940 30881 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:51.983667 30880 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:51.984244 30880 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:51.984603 30880 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:51.952572 30925 raft_consensus.cc:2781] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:52.036054 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.035353 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.040550 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:09:52.009857 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8e80 after lost signal to thread 30341
I20260807 15:09:51.977074 30310 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:09:52.043365 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.049470 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.049880 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:51.989915 30925 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:52.068835 29452 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:52.067690 30725 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:52.068593 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08002a04a0 after lost signal to thread 30831
I20260807 15:09:52.041846 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:52.042188 30908 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:52.074719 30725 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.076490 30837 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:52.086663 30837 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:52.086750 30901 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.087095 30837 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.087334 30901 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:52.089074 30919 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.089337 30901 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:52.089901 30901 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.089628 30919 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.091127 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.081261 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.083781 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.058591 30925 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:09:52.078019 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa540 after lost signal to thread 30833
I20260807 15:09:52.091651 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.075009 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:52.104866 29644 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:52.085579 30776 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.099646 29642 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:09:52.108484 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.109691 29609 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.113291 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.092643 30916 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.094671 30785 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.116339 30945 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.038645 30938 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:52.090386 30901 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:52.121554 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.123174 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.115453 30875 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.125777 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.125793 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.139294 29487 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:09:52.117842 30916 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:52.144315 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.126138 30785 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.149258 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.149267 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.154295 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.156790 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.149909 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.159147 29646 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:09:52.154862 30307 raft_consensus.cc:1261] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:52.164155 29609 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:50.953207 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:52.167914 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:52.168329 30938 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.168640 30785 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:52.170467 30916 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:52.178705 29608 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:09:52.180032 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 53763us
I20260807 15:09:52.181425 29608 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.180562 30938 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 15:09:52.183768 30901 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:52.180006 30880 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.185178 30942 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.187213 30907 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:52.187647 30907 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:09:52.188024 30907 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:52.186125 30935 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:52.189967 29608 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.193173 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.188562 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:52.196712 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.196761 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.198163 30880 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:52.198951 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:52.200011 30307 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.196764 29608 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.208002 29609 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.209386 29637 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:52.211011 30911 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.211612 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.213904 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.211450 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.216226 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.218372 30911 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.195528 30942 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.224485 30947 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.225245 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.227244 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.228744 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.230713 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.234217 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.233570 30837 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:09:52.241743 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 364669us
I20260807 15:09:52.231529 29533 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.244421 30904 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.259074 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.260022 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.323338 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 109) took 1397 ms. Trace:
I20260807 15:09:52.331727 29377 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 222) took 1196 ms. Trace:
I20260807 15:09:52.337976 29377 rpcz_store.cc:276] 0807 15:09:51.135808 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:51.136279 (+ 471us) service_pool.cc:227] Handling call
0807 15:09:52.331647 (+1195368us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1186527,"reported_tablets":1}
I20260807 15:09:52.338419 30274 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:52.336879 29378 rpcz_store.cc:276] 0807 15:09:50.925477 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:50.925616 (+ 139us) service_pool.cc:227] Handling call
0807 15:09:52.323151 (+1397535us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1840,"reported_tablets":3}
I20260807 15:09:52.261289 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.282677 30936 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:52.349905 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:52.358260 29486 raft_consensus.cc:1226] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:52.293036 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.262013 29533 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.347827 30837 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:52.266953 30919 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:52.375612 30936 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.328397 30925 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:09:52.363265 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 101354us
I20260807 15:09:52.364208 30922 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:52.364353 29608 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.383071 29608 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.381565 30922 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:52.387600 30922 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.387627 30901 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.390848 29608 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.392692 30943 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.393150 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1474) took 1199 ms. Trace:
I20260807 15:09:52.394630 29486 rpcz_store.cc:276] 0807 15:09:51.193317 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:51.194022 (+ 705us) service_pool.cc:227] Handling call
0807 15:09:51.965565 (+771543us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5800001898. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d1a2b0 00007f94e0d057f9 00007f94e0d052a2 00007f94da3eb684
0807 15:09:51.965861 (+ 296us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:09:52.358779 (+392918us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:09:52.392859 (+ 34080us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54001649d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:09:52.393061 (+ 202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":948340864}
I20260807 15:09:52.391814 29608 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.399307 29608 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.400002 30901 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.401108 30901 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:52.404043 30909 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:52.404475 30310 raft_consensus.cc:1226] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:52.405023 30909 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.403883 30880 raft_consensus.cc:1050] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:52.407328 30925 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.397343 30785 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.416055 29533 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.421216 30943 consensus_queue.cc:1046] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:52.424516 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.427548 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.427685 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.426827 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.429941 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.431212 30785 raft_consensus.cc:3032] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:52.431269 30924 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:52.432354 30924 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:52.432230 30929 consensus_queue.cc:1046] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:52.433188 30924 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.434314 30929 raft_consensus.cc:3032] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:52.434978 30929 raft_consensus.cc:729] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:52.436890 29608 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.437508 29533 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.441704 29480 raft_consensus.cc:1226] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:52.443084 29609 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.446018 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.448369 29608 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.450373 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.458376 30928 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.459028 30928 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.459620 30892 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.460274 30892 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:52.444171 30785 raft_consensus.cc:729] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:52.461421 30928 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:52.461457 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.462745 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.462952 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.468659 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.468946 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.442662 30837 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:52.470152 29608 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.445030 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.471522 30928 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.451221 30934 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.475333 30893 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:52.475876 30919 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:52.474599 29608 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.484790 29608 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.455116 30945 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.450975 30307 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:52.455354 30905 raft_consensus.cc:2726] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:09:52.470794 30892 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.493813 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:52.495275 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.477150 30947 consensus_queue.cc:1046] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260807 15:09:52.498409 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.482921 30785 consensus_queue.cc:260] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.481881 30837 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:52.501191 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.501755 30785 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.491415 30885 raft_consensus.cc:2741] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 15:09:52.505118 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.505313 30880 consensus_queue.cc:237] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.506780 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:52.509865 30312 raft_consensus.cc:1226] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:52.490185 30928 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.510437 30931 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.509881 29452 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:52.511365 30931 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:52.513108 30874 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:52.513881 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.494797 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.517114 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:52.516117 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.517063 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.490217 30908 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.487090 30909 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:52.492920 30942 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.528250 29645 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:52.487473 30929 consensus_queue.cc:260] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:52.535020 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.538549 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.564920 30922 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:52.492764 30893 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:52.539971 29609 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.572808 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.574285 30922 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.575124 29564 raft_consensus.cc:1261] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:52.546150 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:52.546103 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.547572 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:52.577505 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.562181 29645 raft_consensus.cc:595] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:52.563928 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.517547 30874 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:09:52.583426 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 43598.9us
I20260807 15:09:52.586408 29480 raft_consensus.cc:1226] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:52.592201 30947 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:52.593169 30940 consensus_queue.cc:1046] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260807 15:09:52.554114 30837 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.596516 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:52.598006 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:52.598106 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.572271 30893 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.603529 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:52.608915 30272 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.612332 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:52.615131 30864 tablet_copy_client.cc:531] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:09:52.529754 30907 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.597100 30874 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.601560 30909 consensus_queue.cc:1046] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260807 15:09:52.655808 30814 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.697158 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:52.646417 30776 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260807 15:09:52.674618 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 65897.3us
I20260807 15:09:52.689549 30928 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:09:52.722406 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 81862.5us
I20260807 15:09:52.697393 30921 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:09:52.726879 30885 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 15:09:52.721880 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 75950.7us
W20260807 15:09:52.743292 30952 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.211s user 0.000s sys 0.002s
I20260807 15:09:52.744419 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:52.744906 30901 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:52.745558 30901 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:52.746325 29382 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48690 (request call id 232) took 1172 ms. Trace:
I20260807 15:09:52.748939 29380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 220) took 1022 ms. Trace:
I20260807 15:09:52.749554 29645 raft_consensus.cc:1226] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:09:52.726917 30272 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.758208 30272 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.760330 30814 raft_consensus.cc:2781] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:52.760950 30885 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.762768 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.761013 30814 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.768496 30814 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.769070 30907 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:52.749320 29380 rpcz_store.cc:276] 0807 15:09:51.726631 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:51.735090 (+ 8459us) service_pool.cc:227] Handling call
0807 15:09:52.748769 (+1013679us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":704930,"reported_tablets":1}
I20260807 15:09:52.746724 29382 rpcz_store.cc:276] 0807 15:09:51.574036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:51.574254 (+ 218us) service_pool.cc:227] Handling call
0807 15:09:52.746254 (+1172000us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":651474,"reported_tablets":4}
W20260807 15:09:52.772825 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 71967.1us
I20260807 15:09:52.738224 30931 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.789631 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:52.755722 30913 raft_consensus.cc:3032] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:52.799093 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:52.804766 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:52.797856 30924 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:52.821084 29561 raft_consensus.cc:1226] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:52.800678 30913 raft_consensus.cc:729] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:52.746974 30901 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.833292 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:52.733464 30921 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.804323 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:52.840157 30272 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.837337 29608 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.844172 30937 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.848387 30924 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.826749 30913 consensus_queue.cc:260] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.843555 30956 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260807 15:09:52.857860 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.765053 29449 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.863114 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:52.855233 30905 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:09:52.868464 30921 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:52.843555 30272 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.878551 30937 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.879355 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.867746 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:52.899582 29480 raft_consensus.cc:2379] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 2: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:52.889581 30901 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.891371 30930 consensus_queue.cc:1046] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:52.893929 30929 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.883348 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:52.897009 30913 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:52.912797 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:52.926211 30924 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:09:52.928406 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 163465us
I20260807 15:09:52.934899 30784 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.943822 30893 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:52.939492 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 60350.1us
I20260807 15:09:52.946053 29569 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:52.914451 30937 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:52.929816 29449 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.925554 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:52.956979 30311 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:09:52.957441 29449 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.960906 29449 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.966434 30931 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.967180 29641 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:52.967463 30885 consensus_queue.cc:1046] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:52.968950 30885 raft_consensus.cc:3032] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:52.969509 30885 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:52.959214 30880 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:52.972932 30893 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:52.970527 30885 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:52.979938 30909 consensus_queue.cc:1046] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:52.980793 30776 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:52.982878 30874 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:09:52.959755 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 170947us
I20260807 15:09:52.983325 30864 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:09:52.949311 30937 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:52.995167 29533 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.003551 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.003994 29449 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.006625 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:53.010514 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:53.016886 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:53.008982 30892 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.008324 30937 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.020864 29449 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.026927 29449 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:52.987394 30885 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:52.988644 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:53.001812 30784 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:53.031528 30946 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.031982 30875 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.037525 30939 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:52.991557 30814 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:53.011963 30931 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.030277 29449 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:53.025396 30874 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.040270 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:53.058844 29449 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.072925 29449 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.074667 29449 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.074985 30874 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.075613 30875 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:53.079389 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:53.081801 29449 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.058911 30919 raft_consensus.cc:3032] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:53.092073 29486 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
W20260807 15:09:53.091430 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 80574us
I20260807 15:09:53.089984 29449 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.058620 30946 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.095280 29449 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.098930 29449 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.105685 29533 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.083339 30776 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.057511 30939 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:53.093600 30892 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.117861 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:09:53.122331 29533 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.094198 30875 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.094954 30936 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.092185 30919 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:53.113286 30942 consensus_queue.cc:1046] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260807 15:09:53.126298 30928 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.120573 30776 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.117489 30904 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 15:09:53.176386 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 78375.3us
I20260807 15:09:53.177380 29449 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.178330 30956 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.125535 30954 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:53.181932 29449 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:09:53.182585 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 84243.6us
I20260807 15:09:53.188429 29449 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.189548 29449 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.189810 30956 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.190825 30814 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:53.196098 30946 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.125696 30272 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:53.194676 30937 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:53.221032 30938 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.220891 30939 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:53.233449 30940 raft_consensus.cc:3032] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:53.234010 30926 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.245374 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:53.245697 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:53.254289 29480 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:09:53.254978 29480 raft_consensus.cc:595] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:53.256242 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:53.217281 30814 raft_consensus.cc:2781] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:53.268040 29637 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260807 15:09:53.209146 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 103866us
I20260807 15:09:53.269834 30937 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:53.272974 29560 raft_consensus.cc:1226] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:53.273952 30954 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:53.250664 30940 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:53.287247 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:53.285144 30814 raft_consensus.cc:686] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:53.290726 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:53.295181 30814 consensus_queue.cc:237] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:53.299467 29608 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.304345 29644 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:53.304945 30926 raft_consensus.cc:979] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:53.305888 30926 raft_consensus.cc:1067] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:53.307263 30943 raft_consensus.cc:3032] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:53.308351 30939 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:53.312503 30935 consensus_queue.cc:1046] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:53.284231 30954 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:53.327555 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:53.307838 30943 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:09:53.326673 30970 log.cc:924] Time spent T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.117s user 0.000s sys 0.001s
I20260807 15:09:53.296972 30272 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.349931 29560 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:53.352969 30857 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:53.346220 30954 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:53.368434 30312 raft_consensus.cc:1226] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:53.375993 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:53.377480 30857 tablet_bootstrap.cc:492] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:53.384969 30857 ts_tablet_manager.cc:1397] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 1.478s user 0.042s sys 0.022s
I20260807 15:09:53.377961 30940 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:53.314953 30919 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:53.387153 30885 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 15:09:53.397264 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 100525us
I20260807 15:09:53.404565 30892 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:53.423583 29378 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 2 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:53.430763 30956 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:53.401211 30274 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.357235 30943 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:53.440521 30956 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:53.437904 30940 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.446113 30892 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:53.473112 30857 raft_consensus.cc:348] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:09:53.475165 30973 log.cc:924] Time spent T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.077s user 0.000s sys 0.001s
I20260807 15:09:53.492072 30892 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:53.408874 30946 consensus_queue.cc:1046] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260807 15:09:53.502513 30977 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.520445 30943 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.526145 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:53.521659 30307 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:53.533213 30946 raft_consensus.cc:3032] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:53.533771 30919 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.533910 30946 raft_consensus.cc:729] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:53.536226 29380 catalog_manager.cc:5495] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 15:09:53.476194 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 95959.2us
I20260807 15:09:53.567044 30837 consensus_queue.cc:1046] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 15:09:53.571569 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 311377us
I20260807 15:09:53.483453 30857 raft_consensus.cc:729] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
W20260807 15:09:53.572857 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 399018us
I20260807 15:09:53.575620 30880 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:53.606428 29563 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:09:53.607484 29563 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:53.608210 29563 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.609056 29570 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:09:53.612303 29481 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:09:53.613206 29481 raft_consensus.cc:595] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.618930 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:53.622906 30310 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:53.621747 30776 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:53.624761 30875 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 15:09:53.484380 30941 consensus_queue.cc:1159] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9bbe5c211ab64989a57350f34f007ced" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260807 15:09:53.630947 30874 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:53.639674 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:53.537088 30946 consensus_queue.cc:260] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:53.636174 30874 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:53.657548 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:53.656342 29565 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:53.699347 30864 tablet_bootstrap.cc:700] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Time spent opening tablet: real 0.228s user 0.005s sys 0.000s
I20260807 15:09:53.698076 30956 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:53.639751 30857 consensus_queue.cc:260] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:53.744047 30946 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.769593 29641 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:53.770399 29641 raft_consensus.cc:595] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:53.781694 30857 ts_tablet_manager.cc:1428] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.396s user 0.007s sys 0.007s
I20260807 15:09:53.778306 30971 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260807 15:09:53.732205 30874 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:09:53.819932 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 97569.4us
I20260807 15:09:53.820537 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 15:09:53.822413 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:53.822662 29647 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:53.823096 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:53.824751 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:53.825006 29645 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:53.820077 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-f07d982710354dfca721e4641d589839 received from {username='slave'} at 127.0.0.1:55224
I20260807 15:09:53.806116 30874 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.836495 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-f07d982710354dfca721e4641d589839 on tablet f07d982710354dfca721e4641d589839 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:53.853377 29449 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:53.868276 29533 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.851066 30784 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260807 15:09:53.866595 29645 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:53.863994 30955 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.876992 30931 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:53.900971 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:53.867084 30977 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260807 15:09:53.904894 30978 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:53.907711 29565 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.921960 29565 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:09:53.950104 29563 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:53.952303 29563 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:09:53.956117 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:53.956948 29640 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.960230 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:53.967567 29480 raft_consensus.cc:3032] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:53.968264 29480 raft_consensus.cc:729] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:53.976802 29480 consensus_queue.cc:260] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:53.978437 29480 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:53.967527 30977 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260807 15:09:53.985451 30874 raft_consensus.cc:979] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:53.985983 30874 raft_consensus.cc:1067] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:53.989837 30307 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:53.991494 29645 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:09:53.992174 29645 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:53.992511 29645 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:53.971414 29561 raft_consensus.cc:1226] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:53.986969 30874 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.001858 29645 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.012799 29480 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:54.018925 29644 raft_consensus.cc:1226] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3. Ops: []
I20260807 15:09:54.022436 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:54.024362 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:54.025617 29640 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:54.032132 29645 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:54.033169 30903 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:54.033417 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:54.033845 30903 raft_consensus.cc:686] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:54.034184 30310 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:54.035065 30903 consensus_queue.cc:237] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:54.036371 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:54.070312 30310 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:09:54.124146 29638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:46792 (request call id 743) took 1048 ms. Trace:
I20260807 15:09:54.124693 29638 rpcz_store.cc:276] 0807 15:09:53.068336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:53.068572 (+ 236us) service_pool.cc:227] Handling call
0807 15:09:54.024598 (+956026us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003c7154. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e0d09c6e 00007f94da400807 00007f94da400792 00007f94da4006c1 00007f94da40063c 00007f94da3ff8f2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:09:54.116531 (+ 91933us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1558651136}
I20260807 15:09:54.109290 30938 consensus_queue.cc:1046] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260807 15:09:54.180022 30312 raft_consensus.cc:1226] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3. Ops: []
I20260807 15:09:54.185791 30776 consensus_queue.cc:1046] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:54.186403 29570 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.192633 30308 raft_consensus.cc:1203] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:09:54.196959 30864 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:09:54.198352 30864 tablet_bootstrap.cc:492] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:09:54.199301 30864 ts_tablet_manager.cc:1397] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 1.228s user 0.031s sys 0.025s
I20260807 15:09:54.200667 30911 raft_consensus.cc:979] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:54.221048 30911 raft_consensus.cc:1067] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:54.243467 29486 raft_consensus.cc:3032] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:54.243939 29486 raft_consensus.cc:729] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:54.244724 29486 consensus_queue.cc:260] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.244997 30864 raft_consensus.cc:348] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:54.246007 30864 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:09:54.246690 30864 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:54.250562 30864 ts_tablet_manager.cc:1428] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.044s user 0.007s sys 0.001s
I20260807 15:09:54.253068 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-acc305388a594a0f8be8d24006e0b323 received from {username='slave'} at 127.0.0.1:35570
I20260807 15:09:54.253484 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-acc305388a594a0f8be8d24006e0b323 on tablet acc305388a594a0f8be8d24006e0b323 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:09:54.246712 29570 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:09:54.268522 29486 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:54.276222 29570 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:54.276721 29570 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:54.277889 29486 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:09:54.283344 29570 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:54.286116 29570 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:54.286620 29609 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:54.287539 30901 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:54.288705 30901 raft_consensus.cc:686] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:54.289819 30901 consensus_queue.cc:237] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.290880 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:54.291517 29488 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:54.291880 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:54.292482 29644 raft_consensus.cc:3032] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:54.292766 29644 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:54.293517 29644 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:54.294827 29644 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:54.303332 29382 catalog_manager.cc:5495] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.306968 29644 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:54.308388 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:54.309487 30922 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:54.310138 30922 raft_consensus.cc:686] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:54.329104 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 223) took 1311 ms. Trace:
I20260807 15:09:54.346969 30903 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:09:54.303373 29488 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:54.333650 29378 rpcz_store.cc:276] 0807 15:09:53.017715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:53.017847 (+ 132us) service_pool.cc:227] Handling call
0807 15:09:54.320121 (+1302274us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:09:53.850576 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:09:53.997543 (+146967us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:09:53.997580 (+ 37us) write_op.cc:435] Acquired schema lock
0807 15:09:53.997598 (+ 18us) tablet.cc:660] Decoding operations
0807 15:09:53.997964 (+ 366us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:09:53.998083 (+ 119us) write_op.cc:641] Partition lock acquired for write op
0807 15:09:53.998109 (+ 26us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:09:53.998342 (+ 233us) tablet.cc:699] Row locks acquired
0807 15:09:53.998364 (+ 22us) write_op.cc:260] PREPARE: finished
0807 15:09:53.998506 (+ 142us) write_op.cc:270] Start()
0807 15:09:54.013616 (+ 15110us) write_op.cc:276] Timestamp: P: 1786115393998462 usec, L: 0
0807 15:09:54.023666 (+ 10050us) op_driver.cc:331] REPLICATION: starting
0807 15:09:54.108360 (+ 84694us) log.cc:842] Serialized 539 byte log entry
0807 15:09:54.260344 (+151984us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5400132520. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd5ac33 00007f94dbd5e665 00007f94dbd5e5f9 00007f94dbd5e589 00007f94dbd5e551 00007f94dbd5d84d 00007f94e2100204 00007f94e2100039 00007f94d8e9c6b6 00007f94d8e9fb11
0807 15:09:54.265625 (+ 5281us) op_driver.cc:444] REPLICATION: finished
0807 15:09:54.291834 (+ 26209us) write_op.cc:301] APPLY: starting
0807 15:09:54.291966 (+ 132us) tablet.cc:1365] starting BulkCheckPresence
0807 15:09:54.292066 (+ 100us) tablet.cc:1368] finished BulkCheckPresence
0807 15:09:54.292200 (+ 134us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:09:54.292483 (+ 283us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:09:54.292636 (+ 153us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:09:54.292684 (+ 48us) write_op.cc:312] APPLY: finished
0807 15:09:54.293000 (+ 316us) log.cc:842] Serialized 23 byte log entry
0807 15:09:54.293160 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:09:54.293335 (+ 175us) write_op.cc:454] Released schema lock
0807 15:09:54.293372 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0807 15:09:54.294175 (+ 803us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:09:54.294212 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":25962,"apply.run_cpu_time_us":1933,"apply.run_wall_time_us":2665,"num_ops":1,"prepare.queue_time_us":376516,"prepare.run_cpu_time_us":13501,"prepare.run_wall_time_us":315114,"raft.queue_time_us":65603,"raft.run_cpu_time_us":10651,"raft.run_wall_time_us":53476,"replication_time_us":241851,"spinlock_wait_cycles":25439488,"thread_start_us":352534,"threads_started":4,"wal-append.queue_time_us":90312}]]}
I20260807 15:09:54.357430 30903 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.376621 30977 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:54.392338 30961 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:54.392959 30961 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.395004 30961 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:54.395116 30903 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:54.311563 30922 consensus_queue.cc:237] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:54.396713 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:54.397523 29641 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:54.398823 30272 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:54.402383 30961 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:54.402616 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:54.403748 29486 raft_consensus.cc:2379] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 2: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:54.410455 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:54.411362 29644 raft_consensus.cc:2379] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 3: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:54.403100 30961 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:54.414018 30961 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:54.423002 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:54.389897 30977 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.430475 30307 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:09:54.432091 30961 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.433739 29533 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:09:54.434608 30928 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:54.434998 30928 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:09:54.435344 30928 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:54.435989 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:54.436794 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:54.437839 29637 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:09:54.440305 30272 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:54.441136 30937 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:09:54.441572 30937 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:54.441956 30937 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:54.435341 30977 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:54.458699 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:54.459728 29479 raft_consensus.cc:2379] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 2: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:09:54.470219 30961 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:54.471725 30928 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.475983 29561 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:09:54.476881 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:54.477876 29644 raft_consensus.cc:2379] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 3: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:09:54.480059 30928 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:54.483274 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:54.493081 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:54.509879 29380 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to <none>, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.514089 30901 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:54.527403 30901 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:54.532681 29641 raft_consensus.cc:1261] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:54.533344 30901 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:54.534446 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:54.534857 30922 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:54.535091 29479 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:54.536479 29609 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:54.537659 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:54.540238 30913 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:54.540762 30913 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:54.541102 30913 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:54.552893 30937 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.556036 30307 raft_consensus.cc:2354] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4.
I20260807 15:09:54.564108 29533 leader_election.cc:398] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4.
I20260807 15:09:54.564453 29533 leader_election.cc:401] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 15:09:54.564910 30937 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:54.566313 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:54.566632 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:54.566982 30903 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:54.566999 29640 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:54.578181 29640 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:09:54.584203 30926 raft_consensus.cc:1050] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:54.586498 30272 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:54.589287 30937 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:09:54.581219 29488 consensus_queue.cc:237] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.597039 30937 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:54.611369 29486 raft_consensus.cc:1261] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:54.615546 30307 raft_consensus.cc:1261] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:54.614071 30926 consensus_queue.cc:237] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.618600 30874 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:54.619920 30922 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:54.621055 30913 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:54.615569 30937 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.626437 29382 catalog_manager.cc:5495] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:54.625825 30953 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:54.632313 30953 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:54.631280 29382 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 2, leader changed from <none> to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 2 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.635286 30953 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:54.638007 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:54.638761 29570 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 3
I20260807 15:09:54.640136 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:54.640861 29486 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:54.633648 29382 catalog_manager.cc:5495] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:54.644325 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:54.631306 29561 raft_consensus.cc:1261] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:54.652853 29486 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:09:54.654183 29609 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:54.655426 30901 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:54.656319 30901 raft_consensus.cc:686] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:54.654150 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:54.652480 30958 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:54.663062 30958 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:54.651721 30913 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:54.666361 30874 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:54.666217 29531 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:54.668690 30901 consensus_queue.cc:237] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:54.668656 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:54.668402 29570 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:09:54.666890 30958 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:54.689648 30953 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:09:54.687942 30308 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.683516 29564 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.684254 29561 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:54.694787 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:54.702435 29480 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:09:54.710258 29608 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:54.711385 30940 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:54.712134 30940 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:54.712900 30940 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:54.680395 30874 raft_consensus.cc:2932] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.718573 29563 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:54.751484 29380 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:54.747033 29563 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:09:54.749766 29637 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:09:54.766296 30903 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4.
W20260807 15:09:54.796985 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 59597.1us
I20260807 15:09:54.809033 29481 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:09:54.808446 30272 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:54.817000 30977 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:54.817842 30977 raft_consensus.cc:686] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:54.792465 30880 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:09:54.827780 31009 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
I20260807 15:09:54.850556 30958 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:54.827513 30954 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:54.819078 30977 consensus_queue.cc:237] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.858862 29560 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
W20260807 15:09:54.859447 30998 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.079s user 0.000s sys 0.002s
I20260807 15:09:54.825701 30880 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.879573 29640 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:54.893550 30940 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:54.894896 29640 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:54.878973 30954 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:54.898104 30954 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:54.898317 30776 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:54.906962 30308 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:54.915871 30953 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 15:09:54.918486 31012 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.054s user 0.003s sys 0.001s
I20260807 15:09:54.920167 30880 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:54.930065 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:54.947803 29644 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:54.926405 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:54.949054 30312 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:54.920770 29377 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 4 to 3, term changed from 2 to 3, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195), fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193), VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194), VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195), VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:54.959196 29452 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:54.944969 30940 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:54.923463 30971 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:54.882862 31016 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260807 15:09:54.973232 29564 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:09:54.988090 30938 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:54.988873 30938 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:54.992833 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:54.993705 29644 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:54.995317 29449 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:54.996810 31017 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:54.997283 31017 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:54.997727 31017 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.001125 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:54.974434 30971 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:55.007588 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:55.008353 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:55.008467 29638 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:55.009333 29563 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:09:54.993100 30308 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:09:55.012578 29449 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:55.013700 30776 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:09:55.014132 30776 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:09:55.014700 30776 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:55.014469 30913 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:55.032678 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:55.033353 29481 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
W20260807 15:09:55.045187 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 86109.9us
I20260807 15:09:55.031917 30784 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:55.070199 30784 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.072292 30880 raft_consensus.cc:2781] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:55.072794 30880 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:55.073167 30880 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.078122 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet afaa655e923f4aecbeee1b026c46810e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:55.079317 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:55.081056 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:55.082707 29533 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:55.083947 29479 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.038106 30971 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:55.096632 29480 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 15:09:55.110174 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 167896us
I20260807 15:09:55.112215 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:55.112905 29564 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.110981 30938 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:55.104139 30901 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:55.052505 31018 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260807 15:09:55.132078 30903 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:55.153613 29564 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
W20260807 15:09:55.160213 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 77436.6us
W20260807 15:09:55.162732 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 52698.6us
I20260807 15:09:55.148379 30784 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:55.157770 30903 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:55.173362 29479 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
W20260807 15:09:55.204361 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 86742us
I20260807 15:09:55.167771 30776 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:55.191267 30903 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.215127 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:55.158469 30901 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.217625 30312 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:55.220571 29452 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:09:55.223250 31022 log.cc:924] Time spent T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260807 15:09:55.224361 30874 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:55.224808 30874 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:55.223182 29608 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:55.225311 30874 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.225804 30913 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:55.210521 30926 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260807 15:09:55.226305 30913 raft_consensus.cc:686] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:55.227725 30901 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:55.227252 30913 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:09:55.228286 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:55.205524 30931 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 15:09:55.235116 29564 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:09:55.242244 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:55.264640 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 153397us
I20260807 15:09:55.299806 30931 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:09:55.303824 30931 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:55.306442 30931 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:55.282280 30961 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260807 15:09:55.327782 30776 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:55.328197 31037 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:55.302911 31017 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.334153 29480 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:09:55.318171 30903 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:55.338444 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 127754us
I20260807 15:09:55.355274 31019 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:09:55.356272 31019 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.359193 31019 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:55.361985 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:09:55.362742 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 119222us
I20260807 15:09:55.383273 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:55.388276 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:55.389210 29640 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.396376 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:55.408416 30903 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:55.410866 29640 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:09:55.412335 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:09:55.425583 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 47221.6us
I20260807 15:09:55.427472 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:09:55.428192 29486 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:55.379988 31017 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:55.338423 31013 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260807 15:09:55.419080 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:55.434821 30310 raft_consensus.cc:2379] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:09:55.440251 29561 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:09:55.442579 30880 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.444191 29479 raft_consensus.cc:2354] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:09:55.446557 29449 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:09:55.443980 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:55.448310 29570 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:09:55.452293 30776 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:55.452875 30776 raft_consensus.cc:686] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:55.453962 30776 consensus_queue.cc:237] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.457352 31023 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:55.463137 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:09:55.463646 29533 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:55.464262 30312 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:09:55.447104 29561 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:55.470054 29641 raft_consensus.cc:1226] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:09:55.481364 30885 consensus_queue.cc:1046] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260807 15:09:55.489526 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:55.490063 30880 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:55.490203 29483 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.481752 30953 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:09:55.498237 30953 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:09:55.498642 30953 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.468415 30310 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:55.417112 30874 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.501361 30885 raft_consensus.cc:3032] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:55.501758 30885 raft_consensus.cc:729] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:55.501852 29488 raft_consensus.cc:2354] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:09:55.502616 30885 consensus_queue.cc:260] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.498634 29380 catalog_manager.cc:5495] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:55.477330 29637 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:09:55.513404 29449 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:55.515237 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:55.515643 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:55.516129 29645 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.516471 29637 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.518899 31030 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:55.442703 30956 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:55.519519 31030 raft_consensus.cc:686] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:55.520442 31030 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:55.522722 30874 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:55.524008 29640 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:09:55.524366 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:55.524920 30311 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.497924 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:55.525460 29641 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:55.504841 29380 catalog_manager.cc:5495] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:55.541832 30885 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.510438 30308 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:55.550215 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:55.550864 30312 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.552719 29609 leader_election.cc:398] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:09:55.553166 29609 leader_election.cc:401] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:09:55.561913 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:09:55.564260 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 50985.9us
I20260807 15:09:55.569021 29609 leader_election.cc:398] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:09:55.569384 29609 leader_election.cc:401] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:09:55.574540 29483 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:09:55.585436 30953 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:55.587502 30953 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:55.594111 30312 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:09:55.572116 29638 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.596942 29452 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:55.607409 30938 raft_consensus.cc:2781] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:55.613919 30938 raft_consensus.cc:686] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:55.576493 30937 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260807 15:09:55.614878 30938 consensus_queue.cc:237] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:55.643543 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet afaa655e923f4aecbeee1b026c46810e with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:55.654467 30311 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:09:55.656771 29452 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:55.658814 30956 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:55.659485 30956 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:55.660602 29646 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:55.660379 30956 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:09:55.671463 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 69951.9us
I20260807 15:09:55.671311 29645 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:09:55.696658 29487 raft_consensus.cc:1226] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:09:55.709649 29533 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:55.692258 31019 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:09:55.727316 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:55.732497 29640 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:55.735733 29377 catalog_manager.cc:5495] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:55.692827 29637 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:09:55.739933 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:55.739452 29377 catalog_manager.cc:5495] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:55.730077 31025 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:55.790831 29564 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:55.744190 31023 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:09:55.774456 31025 raft_consensus.cc:686] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:55.804673 29640 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:09:55.802893 30958 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260807 15:09:55.856660 31053 log.cc:924] Time spent T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.088s user 0.000s sys 0.002s
I20260807 15:09:55.896013 31025 consensus_queue.cc:237] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:55.912762 29480 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:09:55.913645 29480 raft_consensus.cc:595] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:09:55.953181 29382 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193), VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194), VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195), VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:55.962982 29561 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:55.964109 29561 raft_consensus.cc:595] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:09:55.984282 29638 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:09:56.023702 31062 tablet_replica.cc:330] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:09:56.062693 29382 catalog_manager.cc:5495] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:56.089006 31017 raft_consensus.cc:979] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:56.089850 31017 raft_consensus.cc:1067] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:56.099738 29638 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:09:56.104262 31062 raft_consensus.cc:2229] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:56.106207 31062 raft_consensus.cc:2258] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:56.126147 31018 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:56.129921 29638 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:09:56.134259 30308 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260807 15:09:56.135191 30308 pending_rounds.cc:76] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: Aborting all ops after (but not including) 4
I20260807 15:09:56.136251 30308 pending_rounds.cc:97] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260807 15:09:56.136978 30308 raft_consensus.cc:2866] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:09:56.131524 29638 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:56.141181 29638 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:56.155475 29646 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3. Ops: []
I20260807 15:09:56.231192 29531 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:09:56.240832 29644 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s user 0.001s sys 0.039s
W20260807 15:09:56.241289 29644 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s user 0.001s sys 0.039s
I20260807 15:09:56.234541 31038 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:56.216295 30880 consensus_queue.cc:1046] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 15:09:56.258878 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:56.263082 29646 raft_consensus.cc:595] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
W20260807 15:09:56.263849 29533 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.008s sys 0.008s
W20260807 15:09:56.264308 29533 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.516s user 0.008s sys 0.008s
W20260807 15:09:56.265691 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 516988us
I20260807 15:09:56.241196 30776 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260807 15:09:56.264475 31038 raft_consensus.cc:686] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:56.270323 31062 ts_tablet_manager.cc:1905] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:56.334815 31038 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.352308 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 15:09:56.395742 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:56.396589 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:09:56.416810 29481 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s user 0.039s sys 0.019s
W20260807 15:09:56.417485 29481 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.701s user 0.039s sys 0.019s
W20260807 15:09:56.422763 29609 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.684s user 0.007s sys 0.055s
W20260807 15:09:56.423197 29609 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.685s user 0.007s sys 0.055s
W20260807 15:09:56.423496 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 685219us
I20260807 15:09:56.431875 29487 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:56.435562 30312 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Advancing to term 3
W20260807 15:09:56.461687 31073 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260807 15:09:56.471630 30312 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:56.517035 29638 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.530956 29638 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:56.586709 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:56.587450 29486 raft_consensus.cc:3032] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:56.587961 29486 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:56.603410 29486 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.604802 29486 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:56.623034 29486 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:56.588236 31013 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260807 15:09:56.625319 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 187528us
I20260807 15:09:56.629055 29568 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3. Ops: []
W20260807 15:09:56.637562 31077 log.cc:924] Time spent T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.126s user 0.000s sys 0.001s
I20260807 15:09:56.638749 30922 raft_consensus.cc:979] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
W20260807 15:09:56.639002 31083 log.cc:924] Time spent T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.078s user 0.000s sys 0.001s
I20260807 15:09:56.639238 31076 raft_consensus.cc:1067] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:56.641466 31040 raft_consensus.cc:3032] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:56.641917 31040 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:56.642810 31040 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.647666 31040 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:56.650478 29638 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:09:56.651150 29638 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:56.651522 29638 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:56.635680 31074 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260807 15:09:56.657488 31075 log.cc:924] Time spent T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.164s user 0.001s sys 0.001s
W20260807 15:09:56.669826 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 56656.7us
I20260807 15:09:56.694254 29609 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:56.696069 31037 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:56.696604 31037 raft_consensus.cc:686] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:56.697476 31037 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.708267 31062 ts_tablet_manager.cc:1918] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:56.718319 31062 log.cc:1196] T afaa655e923f4aecbeee1b026c46810e P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/afaa655e923f4aecbeee1b026c46810e
I20260807 15:09:56.719600 31062 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46792 (request call id 749) took 1076 ms. Trace:
I20260807 15:09:56.720180 31062 rpcz_store.cc:276] 0807 15:09:55.642903 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:09:55.643231 (+ 328us) service_pool.cc:227] Handling call
0807 15:09:56.022946 (+379715us) ts_tablet_manager.cc:1145] Deleting tablet afaa655e923f4aecbeee1b026c46810e
0807 15:09:56.023139 (+ 193us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 15:09:56.678242 (+655103us) tablet_metadata.cc:641] Metadata flushed
0807 15:09:56.691682 (+ 13440us) tablet_metadata.cc:641] Metadata flushed
0807 15:09:56.719489 (+ 27807us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":378637,"thread_start_us":99367,"threads_started":1}
I20260807 15:09:56.735975 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet afaa655e923f4aecbeee1b026c46810e (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:56.735996 29637 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:09:56.737603 30922 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:56.739837 31040 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:09:56.740724 31040 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.764636 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:56.765393 29561 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:56.767876 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:56.768599 29646 raft_consensus.cc:595] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership
I20260807 15:09:56.787990 29646 raft_consensus.cc:1261] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:09:56.800148 31036 raft_consensus.cc:979] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:09:56.840305 31036 raft_consensus.cc:979] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:56.841181 31036 raft_consensus.cc:1067] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:56.844105 31051 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 15:09:56.840481 31096 log.cc:924] Time spent T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.064s user 0.000s sys 0.001s
I20260807 15:09:56.848552 29569 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:09:56.863993 29569 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:56.864547 29569 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:56.775499 29638 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.878242 29638 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:56.881072 29643 raft_consensus.cc:1226] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 1. Current term is 2. Ops: []
I20260807 15:09:56.884028 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:56.884717 29566 raft_consensus.cc:3032] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:56.885035 29566 raft_consensus.cc:729] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:56.886191 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:56.886906 29485 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:09:56.887122 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 60567.9us
I20260807 15:09:56.824398 31070 raft_consensus.cc:1067] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
W20260807 15:09:56.871532 31094 log.cc:924] Time spent T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260807 15:09:56.876030 29637 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 15:09:56.885937 29566 consensus_queue.cc:260] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:56.874692 31084 log.cc:924] Time spent T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.050s user 0.001s sys 0.000s
I20260807 15:09:56.901590 29485 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:56.902217 29561 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:56.902757 30307 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48588
I20260807 15:09:56.903401 31040 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:56.913712 29382 catalog_manager.cc:5495] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 3, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:56.911779 29378 catalog_manager.cc:5495] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:56.914434 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:09:56.919020 29566 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:56.921872 29569 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.926651 29569 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:56.926462 29378 catalog_manager.cc:5495] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:56.942694 29609 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:56.954449 29566 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:56.939426 30307 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
W20260807 15:09:56.959338 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 152482us
I20260807 15:09:56.964781 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:56.965658 29640 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:56.966039 29640 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:56.983112 31070 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:56.983965 31070 raft_consensus.cc:686] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:56.985087 31070 consensus_queue.cc:237] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:56.993134 29485 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 15:09:56.993276 29487 raft_consensus.cc:1261] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:09:56.993554 29485 pending_rounds.cc:76] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced: Aborting all ops after (but not including) 1
I20260807 15:09:56.993844 29485 pending_rounds.cc:97] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 15:09:56.994091 29485 raft_consensus.cc:2866] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:09:56.999444 31051 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:56.959519 30307 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:57.003022 31013 raft_consensus.cc:1050] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:09:57.004823 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:09:57.006109 29640 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:57.020156 29450 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:09:57.023518 31031 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:09:57.019255 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:57.025202 29485 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:57.031113 31101 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:57.096400 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:57.097114 29646 raft_consensus.cc:595] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership
I20260807 15:09:57.112650 31013 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:57.123811 29561 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 15:09:57.124631 29365 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b1d288f694924e79826a10fc7cff8351 already in progress [suppressed 3 similar messages]
I20260807 15:09:57.123837 29640 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:57.126940 29486 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 15:09:56.920377 31035 consensus_queue.cc:1159] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b092f7f951b4137b5d7810056684270" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 15:09:57.160313 29485 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:57.164384 29640 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:57.131781 30307 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:57.170457 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:57.171200 29487 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:57.171749 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:57.172498 29640 raft_consensus.cc:3032] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:09:57.172852 29640 raft_consensus.cc:729] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:57.173892 29531 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:57.177745 31035 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:57.178610 31035 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:57.180998 29487 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:09:57.180917 31035 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:57.185832 30901 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:57.188817 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:57.190071 29563 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:09:57.192736 29365 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 68129.1us
I20260807 15:09:57.185220 29640 consensus_queue.cc:260] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:57.173286 30307 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:57.194370 29640 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:57.203769 29640 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:09:57.220321 30272 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:57.223098 31098 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:09:57.223975 31098 raft_consensus.cc:686] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:09:57.225709 31098 consensus_queue.cc:237] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:57.208636 30901 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260807 15:09:57.251772 29637 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:57.253005 29637 raft_consensus.cc:595] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Received request to transfer leadership
I20260807 15:09:57.255816 31036 raft_consensus.cc:1013] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: attempt to promote peer fbf78964d70448269802ac7de9d7a198: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260807 15:09:57.264612 29566 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:09:57.253582 29637 raft_consensus.cc:603] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 15:09:57.273291 29432 auto_rebalancer.cc:663] Could not move replica: Illegal state: not currently leader
W20260807 15:09:57.273815 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Illegal state: not currently leader
I20260807 15:09:57.278164 29487 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:09:57.277623 31036 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:57.292496 30307 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:09:57.295542 31013 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:57.293419 29563 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:09:57.305169 31034 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260807 15:09:57.359489 30901 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.389020 29487 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:09:57.407557 31111 log.cc:924] Time spent T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.144s user 0.006s sys 0.000s
I20260807 15:09:57.413888 30307 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.418903 29563 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.445438 29382 catalog_manager.cc:5495] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.455068 29382 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.457733 29382 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 4 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:57.519325 29377 catalog_manager.cc:5495] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:57.520872 29382 catalog_manager.cc:5495] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.530591 29487 consensus_queue.cc:237] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:57.542732 29645 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:57.542829 30308 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:09:57.545513 31029 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:57.549906 31018 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:09:57.573135 29378 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:57.580585 29563 raft_consensus.cc:1261] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:57.584910 30901 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:57.589035 29487 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:57.591099 31076 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260807 15:09:57.601336 29487 raft_consensus.cc:1261] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:57.609134 31029 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.610272 29637 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:57.612553 31076 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:57.616940 31074 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:57.624290 29637 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.653481 29380 catalog_manager.cc:5495] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:57.666057 30308 raft_consensus.cc:2932] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.707528 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f07d982710354dfca721e4641d589839 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:57.740792 29378 catalog_manager.cc:5495] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.751077 29643 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:57.769580 29569 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:09:57.771333 30308 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:09:57.772953 30901 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:57.774796 29563 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:09:57.784132 30901 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:09:57.786080 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet f07d982710354dfca721e4641d589839 with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:09:57.806308 31070 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.804101 31044 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260807 15:09:57.808614 29637 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:09:57.813458 29563 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.814618 31044 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:09:57.822786 31123 tablet_replica.cc:330] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:09:57.823974 31123 raft_consensus.cc:2229] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:57.828799 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet acc305388a594a0f8be8d24006e0b323 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:57.830782 31123 raft_consensus.cc:2258] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:57.820446 30307 raft_consensus.cc:2932] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:57.842078 29487 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:09:57.845345 30937 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:09:57.874104 31123 ts_tablet_manager.cc:1905] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:57.882519 29378 catalog_manager.cc:5495] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:09:57.914346 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:57.928445 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet acc305388a594a0f8be8d24006e0b323 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33668
I20260807 15:09:57.943989 31130 tablet_replica.cc:330] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:09:57.972493 31130 raft_consensus.cc:2229] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:57.973539 31130 raft_consensus.cc:2258] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:57.980175 31130 ts_tablet_manager.cc:1905] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:58.005141 31123 ts_tablet_manager.cc:1918] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:09:58.005827 31123 log.cc:1196] T f07d982710354dfca721e4641d589839 P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/f07d982710354dfca721e4641d589839
I20260807 15:09:58.007958 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet f07d982710354dfca721e4641d589839 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:58.019881 31130 ts_tablet_manager.cc:1918] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260807 15:09:58.020576 31130 log.cc:1196] T acc305388a594a0f8be8d24006e0b323 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/acc305388a594a0f8be8d24006e0b323
I20260807 15:09:58.023371 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet acc305388a594a0f8be8d24006e0b323 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:58.036226 29568 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:58.036950 29568 raft_consensus.cc:595] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:09:58.040244 29568 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:58.040886 29568 raft_consensus.cc:595] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:09:58.044804 29568 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:58.045411 29568 raft_consensus.cc:595] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:09:58.048494 29483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b6072ace00c943b19f41dba76504e780"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:09:58.049100 29483 raft_consensus.cc:595] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:58.050392 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 15:09:58.052381 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:58.053112 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:58.055382 30307 consensus_queue.cc:237] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:58.063086 29568 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:09:58.064760 29483 raft_consensus.cc:1261] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:09:58.065129 30937 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:09:58.067350 31098 consensus_queue.cc:1035] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:09:58.075999 31098 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:58.080472 29487 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:58.093314 31040 raft_consensus.cc:979] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:58.093923 31040 raft_consensus.cc:1067] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:58.107618 29561 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b6072ace00c943b19f41dba76504e780"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:09:58.108291 29561 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:58.108705 29561 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:58.119624 29561 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.122148 29561 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:58.123535 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:58.124346 29637 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:58.140791 29637 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:58.148754 29531 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:58.149698 31038 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:58.150242 31038 raft_consensus.cc:686] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:58.151166 31038 consensus_queue.cc:237] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.152591 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:58.153304 29483 raft_consensus.cc:3032] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:58.160213 29483 raft_consensus.cc:729] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:58.159087 29561 raft_consensus.cc:2932] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:58.161372 29483 consensus_queue.cc:260] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.162719 29483 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:58.165948 31051 raft_consensus.cc:979] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:58.166551 31076 raft_consensus.cc:1067] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:58.169543 29637 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:09:58.170567 29637 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:58.170965 29637 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:58.175004 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet b1d288f694924e79826a10fc7cff8351 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:09:58.171620 29377 catalog_manager.cc:5495] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 4 to 7, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 4 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:09:58.192203 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet b1d288f694924e79826a10fc7cff8351 with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46792
I20260807 15:09:58.212335 29483 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:58.218096 29377 catalog_manager.cc:5495] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:58.227644 31134 tablet_replica.cc:330] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:09:58.232321 31134 raft_consensus.cc:2229] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 15:09:58.234755 31134 raft_consensus.cc:2258] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 15:09:58.241119 31134 ts_tablet_manager.cc:1905] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:09:58.244942 31051 raft_consensus.cc:979] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:58.245555 31076 raft_consensus.cc:1067] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:58.247382 29645 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:09:58.235966 29637 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.248138 29645 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:58.248718 29645 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:58.250623 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:58.251327 29483 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:58.251411 29637 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:58.255178 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:58.255832 29568 raft_consensus.cc:3032] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:09:58.256186 29568 raft_consensus.cc:729] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:58.256716 29645 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.257575 29568 consensus_queue.cc:260] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.258767 29568 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:09:58.259387 29645 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:58.260280 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:58.260905 29487 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:58.262691 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:58.263389 29563 raft_consensus.cc:3032] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:58.263706 29563 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:58.264832 29563 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.270432 29563 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:58.278460 29563 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:58.283419 31134 ts_tablet_manager.cc:1918] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260807 15:09:58.276036 29487 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:58.288367 29609 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:58.290131 31070 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:58.290271 31134 log.cc:1196] T b1d288f694924e79826a10fc7cff8351 P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/b1d288f694924e79826a10fc7cff8351
I20260807 15:09:58.291224 31070 raft_consensus.cc:686] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:58.284818 29483 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:09:58.292987 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet b1d288f694924e79826a10fc7cff8351 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:09:58.294528 31070 consensus_queue.cc:237] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.295006 29609 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:58.295971 31074 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:09:58.296442 31074 raft_consensus.cc:686] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:58.284284 29568 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:09:58.297211 31074 consensus_queue.cc:237] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.346347 29377 catalog_manager.cc:5495] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:58.378957 29377 catalog_manager.cc:5495] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:58.387660 31076 raft_consensus.cc:979] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:58.388381 31038 raft_consensus.cc:1067] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:58.392477 29645 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:09:58.393427 29645 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:58.394373 29645 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:58.410782 29645 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.413775 29645 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:58.414585 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:58.415096 29487 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:58.421149 29487 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:09:58.422295 29609 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:58.423121 31070 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:58.423157 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:58.424129 31070 raft_consensus.cc:686] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:58.424175 29563 raft_consensus.cc:3032] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:58.425467 29563 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:58.425279 31070 consensus_queue.cc:237] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.426537 29563 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:58.428123 29563 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:58.442929 29563 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:09:58.459098 29377 catalog_manager.cc:5495] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:09:58.757441 29645 raft_consensus.cc:1261] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:58.757906 29483 raft_consensus.cc:1261] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:09:58.761622 31038 consensus_queue.cc:1035] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:58.760349 31074 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 15:09:58.774644 29487 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:58.776461 31070 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:58.787032 29485 raft_consensus.cc:1261] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:09:58.809625 31035 consensus_queue.cc:1035] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:59.004743 29561 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:59.030556 29563 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 15:09:59.058722 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 91088.8us
I20260807 15:09:59.129333 29486 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:09:59.158280 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:59.178517 31170 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:59.222079 31153 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:59.275527 31170 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:09:59.277931 29568 raft_consensus.cc:1261] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:09:59.298583 31153 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:09:59.327826 29637 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:59.329140 29637 raft_consensus.cc:595] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:59.335985 29561 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
W20260807 15:09:59.336644 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 46512.5us
I20260807 15:09:59.337292 29561 raft_consensus.cc:595] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:09:59.349398 29487 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:09:59.350272 29487 raft_consensus.cc:595] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:59.355731 29561 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:09:59.356896 29561 raft_consensus.cc:595] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:09:59.360250 29637 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:09:59.361038 29637 raft_consensus.cc:595] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:09:59.362428 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 15:09:59.364398 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:09:59.376466 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:09:59.449834 29568 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:09:59.460879 29533 consensus_peers.cc:487] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9b0eecfdf5242a3b82bc6217faa4b96. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:09:59.460886 29637 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:59.464656 31173 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:59.465054 29487 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:09:59.466606 31038 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:09:59.477253 31173 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:59.479405 29487 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:59.481132 29637 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:09:59.512617 29378 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
W20260807 15:09:59.524601 29432 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: leader transfer in progress
I20260807 15:09:59.547070 31074 raft_consensus.cc:979] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:59.547647 31074 raft_consensus.cc:1067] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:59.551301 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:09:59.551972 29566 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:59.552417 29566 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:09:59.560895 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 030a7060e7f744ff9a4e02ea0cd710bd, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:59.561295 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 030a7060e7f744ff9a4e02ea0cd710bd, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:59.565593 31145 raft_consensus.cc:979] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:09:59.566092 31145 raft_consensus.cc:1067] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:09:59.568153 29485 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:09:59.568830 29485 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:59.569257 29485 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:59.577415 29566 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:59.578761 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 18498fa007b248e9af1c1eaeee728541, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
W20260807 15:09:59.579147 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 18498fa007b248e9af1c1eaeee728541, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:09:59.580634 29566 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:59.581516 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:59.581830 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:59.582326 29486 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:59.582507 29646 raft_consensus.cc:3032] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:59.582981 29646 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:59.583806 29646 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:59.587757 29646 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:59.592060 29486 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:09:59.593535 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:59.594322 29485 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:59.600204 29485 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:09:59.604065 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:59.604657 29640 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:59.605147 29646 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:09:59.612207 31145 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:59.612812 29640 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:09:59.612957 31145 raft_consensus.cc:686] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:59.614400 29449 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:09:59.613996 31145 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:59.617653 31160 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:09:59.621498 31160 raft_consensus.cc:686] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:59.623338 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:59.624078 29566 raft_consensus.cc:3032] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:09:59.624408 29566 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:59.625293 29566 consensus_queue.cc:260] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:59.625190 31160 consensus_queue.cc:237] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:59.626617 29566 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:09:59.651039 29566 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
W20260807 15:09:59.655341 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8f248aa577ff4c798c99df5834ea66e5, TS 9bbe5c211ab64989a57350f34f007ced -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:09:59.655699 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8f248aa577ff4c798c99df5834ea66e5, TS 9bbe5c211ab64989a57350f34f007ced -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:09:59.660756 31166 raft_consensus.cc:979] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:59.664229 31166 raft_consensus.cc:1067] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:59.650126 29377 catalog_manager.cc:5495] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:59.677134 29380 catalog_manager.cc:5495] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:59.681373 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:09:59.681954 29566 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:59.682286 29566 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.698746 29566 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:59.701079 29566 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:59.701635 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:09:59.702282 29485 raft_consensus.cc:3032] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:59.702577 29485 raft_consensus.cc:729] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:09:59.703377 29485 consensus_queue.cc:260] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:59.704840 29485 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.712216 29485 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:59.714394 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:59.715095 30308 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.723178 30308 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:59.726024 29533 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:59.726851 31173 raft_consensus.cc:2781] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:59.728014 31173 raft_consensus.cc:686] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:59.729157 31173 consensus_queue.cc:237] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:09:59.803256 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 47084.4us
I20260807 15:09:59.804288 29380 catalog_manager.cc:5495] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:59.848861 31145 raft_consensus.cc:979] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:59.849537 31051 raft_consensus.cc:1067] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:09:59.851023 29646 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:09:59.851522 29646 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:59.851841 29646 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.858560 29646 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:59.860845 29646 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:59.862246 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:09:59.862928 29566 raft_consensus.cc:3032] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:59.863334 29566 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:59.864120 29566 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:59.866590 29566 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.867306 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:59.867937 30308 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.873664 31165 raft_consensus.cc:979] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:59.873907 29566 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:59.874248 31074 raft_consensus.cc:1067] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:09:59.875255 29608 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:09:59.877646 29568 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:09:59.877658 31074 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:59.878226 29568 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:09:59.878320 31074 raft_consensus.cc:686] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:59.878593 29568 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.879393 31074 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:59.877731 30308 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:09:59.886466 29568 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:59.889261 29568 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:09:59.891006 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:09:59.891664 30308 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.894220 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:09:59.894922 29646 raft_consensus.cc:3032] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:09:59.895219 29646 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:09:59.896098 29646 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:59.897514 29646 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:09:59.896832 29380 catalog_manager.cc:5495] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:59.900746 30308 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:59.905189 29646 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:09:59.902951 29533 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:09:59.907007 31051 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:09:59.907850 31051 raft_consensus.cc:686] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:09:59.908865 31051 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:09:59.944862 29377 catalog_manager.cc:5495] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:09:59.947017 31194 ts_tablet_manager.cc:927] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:09:59.959374 31194 tablet_copy_client.cc:316] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:09:59.968587 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet e9b0eecfdf5242a3b82bc6217faa4b96 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:09:59.969276 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet e9b0eecfdf5242a3b82bc6217faa4b96 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-e9b0eecfdf5242a3b82bc6217faa4b96
I20260807 15:09:59.982321 29579 tablet_copy_source_session.cc:205] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:09:59.993290 31194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9b0eecfdf5242a3b82bc6217faa4b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:00.020195 31194 tablet_copy_client.cc:791] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:00.020915 31194 tablet_copy_client.cc:655] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:00.028163 31194 tablet_copy_client.cc:531] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:00.038359 31194 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:00.057963 29486 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:00.060012 31051 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:00.063483 31194 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:00.064553 31194 tablet_bootstrap.cc:492] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:00.065769 29646 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:00.066754 31194 ts_tablet_manager.cc:1397] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.012s
I20260807 15:10:00.070730 31145 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:00.071223 31194 raft_consensus.cc:348] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:00.072180 31194 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:00.072846 31194 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:00.102676 31194 ts_tablet_manager.cc:1428] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.035s user 0.007s sys 0.002s
I20260807 15:10:00.114125 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-e9b0eecfdf5242a3b82bc6217faa4b96 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:10:00.114708 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-e9b0eecfdf5242a3b82bc6217faa4b96 on tablet e9b0eecfdf5242a3b82bc6217faa4b96 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:00.130293 29479 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:00.168497 29566 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:00.181154 31148 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:00.187754 31166 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:00.227954 29646 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:00.232128 31160 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:00.258497 30311 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:00.264708 31145 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:00.279639 29568 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:00.284502 31170 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:00.326185 30308 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:00.329216 30308 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:00.330497 31051 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:00.329221 31074 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260807 15:10:00.401902 31208 log.cc:924] Time spent T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.077s user 0.000s sys 0.000s
I20260807 15:10:00.448580 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:00.452312 30312 raft_consensus.cc:1203] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:10:00.509088 29487 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:00.509857 29487 raft_consensus.cc:595] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:00.512020 29637 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:00.520757 31051 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:00.520933 29637 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:00.521720 29637 raft_consensus.cc:595] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:00.525439 29566 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:00.526023 29566 raft_consensus.cc:595] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:00.530791 29565 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:00.531322 29565 raft_consensus.cc:595] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:00.535133 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 15:10:00.537964 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:00.538707 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:00.693123 31051 raft_consensus.cc:979] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:00.695528 31051 raft_consensus.cc:1067] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:00.710466 29487 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:00.711009 29487 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:00.711342 29487 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:00.729827 29487 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:00.734072 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:00.735725 29566 raft_consensus.cc:3032] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:00.736063 29566 raft_consensus.cc:729] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:00.736825 29566 consensus_queue.cc:260] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:00.738528 29566 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:00.743824 29487 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:00.745056 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:00.745643 29646 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:00.745896 29566 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:00.747027 29450 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:00.747843 31166 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:00.748358 31166 raft_consensus.cc:686] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:00.749198 31166 consensus_queue.cc:237] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:00.752489 29646 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:00.772382 29378 catalog_manager.cc:5495] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:00.801174 31148 raft_consensus.cc:1050] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
W20260807 15:10:00.801685 31148 raft_consensus.cc:1054] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Unable to promote non-voter fbf78964d70448269802ac7de9d7a198: Service unavailable: leader transfer in progress
I20260807 15:10:00.845574 31166 raft_consensus.cc:979] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:00.846187 31166 raft_consensus.cc:1067] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:00.855881 31074 raft_consensus.cc:979] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:00.856455 31074 raft_consensus.cc:1067] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:00.860687 29565 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:00.861392 29565 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:00.861763 29565 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:00.858238 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:10:00.865125 29566 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:00.865525 29566 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:00.869951 29565 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:00.872574 29565 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:00.873299 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:00.874330 29637 raft_consensus.cc:3032] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:00.874718 29637 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:00.875470 29637 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:00.876129 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:00.876799 30307 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:00.876957 29637 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:00.888991 29637 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:00.890363 29531 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:00.890661 29566 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:00.891433 31169 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:00.893123 29566 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:00.892015 31169 raft_consensus.cc:686] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:00.894313 31169 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:00.894951 30307 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:00.896123 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:00.896770 30308 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:00.900316 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:00.900990 29483 raft_consensus.cc:3032] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:00.901254 29483 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:00.902058 29483 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:00.903452 29483 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:00.916721 30308 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:00.918048 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:00.919193 31148 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:00.919740 31148 raft_consensus.cc:686] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:00.920778 31148 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:00.935573 29378 catalog_manager.cc:5495] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:00.959671 29483 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:00.973734 29378 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:01.059044 31159 raft_consensus.cc:979] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:01.060216 31169 raft_consensus.cc:1067] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:01.061960 29637 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:10:01.062476 29637 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:01.062772 29637 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.072530 29637 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:01.075507 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:01.076138 29483 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.082084 29637 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:01.082103 29483 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:01.083822 29609 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:01.084738 31165 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:01.084877 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:01.085733 29566 raft_consensus.cc:3032] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:01.085270 31165 raft_consensus.cc:686] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:01.088779 31165 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:01.093343 29566 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:01.094259 29566 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:01.095994 29566 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.109227 29566 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:01.111047 29378 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:01.268260 29563 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:10:01.269702 31166 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:01.308475 29637 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:10:01.310712 31166 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:01.318802 30308 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:01.325003 31216 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:01.344539 29640 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:01.346534 31148 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:01.398793 30307 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:01.400769 31216 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:01.469909 29483 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:01.473623 31051 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:01.501487 30312 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Advancing to term 2
I20260807 15:10:01.509224 30312 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 15:10:01.515684 31170 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:01.540366 29563 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 15:10:01.542240 31165 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:01.627831 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:01.643548 29483 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 15:10:01.658227 31170 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:01.664893 31170 raft_consensus.cc:1050] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:01.668794 31170 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:01.682977 30312 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:01.684649 31237 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:01.692750 29487 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:01.694759 31165 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:01.710418 31236 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:01.713033 29479 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:01.716574 29566 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:01.719728 31165 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:01.747289 29563 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:01.748045 29563 raft_consensus.cc:595] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:01.750680 29479 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:01.751286 29479 raft_consensus.cc:595] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:01.739055 29566 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:01.759347 29378 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:01.764839 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "995314457256466c935b10a561d7003e"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:01.765789 29646 raft_consensus.cc:595] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:01.770552 29563 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:01.771353 29563 raft_consensus.cc:595] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:01.773471 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 15:10:01.776298 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:01.778492 30312 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:01.777154 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:01.879031 31203 raft_consensus.cc:979] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:01.879537 31203 raft_consensus.cc:1067] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:01.885797 31237 raft_consensus.cc:979] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:01.886314 31237 raft_consensus.cc:1067] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:01.888821 29563 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "995314457256466c935b10a561d7003e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:01.889413 29563 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:01.889746 29563 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.890528 29643 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:01.891106 29643 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:01.891402 29643 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.906056 29643 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:01.906563 29563 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:01.907852 29643 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:01.908551 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:01.909153 29479 raft_consensus.cc:3032] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:01.909219 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:01.909498 29479 raft_consensus.cc:729] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:01.909756 29566 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.910259 29479 consensus_queue.cc:260] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:01.911405 29479 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.915591 29563 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:01.915784 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:01.916538 29483 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.919739 29479 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:01.921921 29609 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:01.922744 31165 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:01.923256 31165 raft_consensus.cc:686] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:01.924307 31165 consensus_queue.cc:237] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:01.931034 29483 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:01.932395 29533 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:01.933629 31051 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:01.934171 31051 raft_consensus.cc:686] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:01.935134 31051 consensus_queue.cc:237] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:01.938934 29566 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:01.956292 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:01.956995 29643 raft_consensus.cc:3032] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:01.957306 29643 raft_consensus.cc:729] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:01.966626 29643 consensus_queue.cc:260] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:01.982355 29379 catalog_manager.cc:5495] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:01.988134 29643 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:01.985001 29380 catalog_manager.cc:5495] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:02.003155 29643 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:02.244760 29646 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:02.249605 31051 raft_consensus.cc:979] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:02.250181 31159 raft_consensus.cc:1067] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:02.251804 29643 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:10:02.252382 29643 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:02.252740 29643 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:02.253736 29566 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:02.255281 31165 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:10:02.257438 30307 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:02.260221 29643 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:02.266600 31237 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:02.267848 29643 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:02.269567 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:02.270187 29565 raft_consensus.cc:3032] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:02.270507 29565 raft_consensus.cc:729] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:02.271353 29565 consensus_queue.cc:260] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:02.277083 31153 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:02.280274 29566 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:02.280261 29565 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:02.287976 31051 raft_consensus.cc:979] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:02.288540 31051 raft_consensus.cc:1067] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:02.290217 29487 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:02.290831 29487 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:02.291188 29487 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:02.293394 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:02.294003 29483 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:02.309952 30307 raft_consensus.cc:2932] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:02.319001 29483 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:02.322520 29479 raft_consensus.cc:1261] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:02.325230 31051 consensus_queue.cc:1035] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:02.333537 29646 raft_consensus.cc:1261] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:02.335130 29565 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:02.336212 29608 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:02.336553 31051 consensus_queue.cc:1035] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:02.337108 31237 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:02.337606 31237 raft_consensus.cc:686] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:02.338550 31237 consensus_queue.cc:237] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:02.328372 29487 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:02.350332 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:02.350932 29565 raft_consensus.cc:3032] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:02.351215 29565 raft_consensus.cc:729] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:02.352988 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:02.353609 29637 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:02.361974 29637 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:02.363302 29487 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:02.382234 29380 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:02.397377 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 60952.2us
I20260807 15:10:02.414978 29563 raft_consensus.cc:1261] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 15:10:02.417297 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 61802.7us
I20260807 15:10:02.417210 31236 consensus_queue.cc:1035] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:02.422434 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet e9b0eecfdf5242a3b82bc6217faa4b96 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33668
I20260807 15:10:02.427016 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e9b0eecfdf5242a3b82bc6217faa4b96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:02.367331 29565 consensus_queue.cc:260] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:02.428943 29565 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:02.431286 29449 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:02.432261 31203 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:02.432785 31203 raft_consensus.cc:686] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:02.433706 31203 consensus_queue.cc:237] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:02.473209 29565 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:02.510365 29380 catalog_manager.cc:5495] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 2 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
W20260807 15:10:02.511518 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 63515.6us
I20260807 15:10:02.513391 29379 catalog_manager.cc:5495] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } }
W20260807 15:10:02.542825 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 162181us
I20260807 15:10:02.564922 31260 tablet_replica.cc:330] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:10:02.566730 31260 raft_consensus.cc:2229] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:02.567696 31260 raft_consensus.cc:2258] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Raft consensus is shut down!
W20260807 15:10:02.588593 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 127889us
I20260807 15:10:02.772220 29479 raft_consensus.cc:1261] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 15:10:02.781669 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 128693us
W20260807 15:10:02.883796 31252 log.cc:924] Time spent T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.333s user 0.002s sys 0.000s
I20260807 15:10:02.910646 31260 ts_tablet_manager.cc:1905] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:02.917142 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:02.961722 31265 consensus_queue.cc:1035] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:02.963706 29566 raft_consensus.cc:1261] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 15:10:02.995024 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 381704us
I20260807 15:10:03.002660 29643 raft_consensus.cc:1261] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:03.039746 31291 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:03.068621 29486 raft_consensus.cc:1261] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:03.139588 31287 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260807 15:10:03.165625 31260 ts_tablet_manager.cc:1918] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260807 15:10:03.167635 31260 log.cc:1196] T e9b0eecfdf5242a3b82bc6217faa4b96 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/e9b0eecfdf5242a3b82bc6217faa4b96
W20260807 15:10:03.179667 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 122096us
I20260807 15:10:03.186798 29566 raft_consensus.cc:1261] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:03.238543 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet e9b0eecfdf5242a3b82bc6217faa4b96 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:03.238925 31153 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:03.239997 29565 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b6072ace00c943b19f41dba76504e780"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:03.240774 29565 raft_consensus.cc:595] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:03.243057 31263 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:03.249467 29483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:03.250118 29483 raft_consensus.cc:595] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:03.259430 29640 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:03.260167 29640 raft_consensus.cc:595] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:03.265321 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 15:10:03.267562 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:03.270612 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:03.302664 31203 raft_consensus.cc:979] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:03.303781 31203 raft_consensus.cc:1067] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:03.306087 29640 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:03.306839 29640 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:03.307260 29640 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:03.333618 29640 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:03.345983 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:03.346740 29483 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:03.347100 29483 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:03.348030 29483 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:03.349372 29483 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:03.354687 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:03.355305 30307 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:03.352262 29640 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:03.370286 30307 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:03.372534 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:03.373689 31275 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:03.370910 29483 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:03.376119 31275 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:03.379750 31275 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:03.458714 29380 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 3, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:03.621901 29483 consensus_queue.cc:237] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:03.644169 31277 raft_consensus.cc:979] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:03.644841 31274 raft_consensus.cc:1067] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:03.647006 29479 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b6072ace00c943b19f41dba76504e780"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:03.652943 29479 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:03.653393 29479 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:03.658631 31271 raft_consensus.cc:979] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:03.659301 31292 raft_consensus.cc:1067] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:03.661715 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:03.662427 29566 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:03.662835 29566 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:03.675776 29566 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:03.681392 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:03.682250 29485 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:03.691363 29485 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:03.697558 29533 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:03.698773 31274 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:03.699373 31274 raft_consensus.cc:686] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:03.700415 31274 consensus_queue.cc:237] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:03.702378 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:03.703106 29637 raft_consensus.cc:3032] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:03.703446 29637 raft_consensus.cc:729] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:03.704519 29637 consensus_queue.cc:260] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:03.713521 29637 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:03.729435 29566 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:03.741148 29479 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:03.749338 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:03.750392 29566 raft_consensus.cc:3032] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:03.750717 29566 raft_consensus.cc:729] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:03.752435 29637 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:03.754189 29479 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:03.757462 29380 catalog_manager.cc:5495] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:03.787545 29566 consensus_queue.cc:260] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:03.788947 29566 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:03.801254 29452 consensus_peers.cc:487] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f23cf6497a87482cb9bd824261ba383f. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:03.810413 29566 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:03.811283 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:03.811849 29637 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:03.817286 29646 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:03.830868 29565 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:03.834290 29450 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:03.837605 31290 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:03.837764 31312 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:03.845427 31313 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:03.869645 31290 raft_consensus.cc:686] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:03.871591 31290 consensus_queue.cc:237] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:03.874330 31278 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:03.878530 29640 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:03.878829 29637 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:03.878618 29565 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:03.894291 29483 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:03.896101 31165 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:03.908469 29380 catalog_manager.cc:5495] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:03.904141 29566 consensus_queue.cc:237] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:03.915530 30312 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:03.921666 31165 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:03.949018 29382 catalog_manager.cc:5495] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
W20260807 15:10:03.963274 29533 consensus_peers.cc:487] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a0ef49386d543e6bf09732d79976e83. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:03.967087 29640 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 15:10:03.969059 31314 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:04.002206 29486 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 15:10:04.007397 31256 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:04.068238 31256 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.074440 29483 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.076870 29640 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.128825 29379 catalog_manager.cc:5495] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.141604 29483 consensus_queue.cc:237] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:04.160048 29485 raft_consensus.cc:1261] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:04.162267 31277 consensus_queue.cc:1035] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:04.165343 29640 raft_consensus.cc:1261] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:04.167596 31256 consensus_queue.cc:1035] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 15:10:04.187638 29452 consensus_peers.cc:487] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a1d390489b54758a0ce36af133f1d57. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:04.188607 29646 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:04.190491 29566 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:04.191941 31290 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:04.195091 31278 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:04.218245 31312 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.234061 29483 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:04.236865 29565 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.375027 29566 raft_consensus.cc:1261] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:04.394500 29646 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.413626 29382 catalog_manager.cc:5495] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
W20260807 15:10:04.422219 29452 consensus_peers.cc:487] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 990a0811150c4c53ae50cc69c71f2926. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:04.418030 31290 consensus_queue.cc:1035] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:04.434051 29637 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:04.438889 31312 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:04.441624 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:04.466641 29637 raft_consensus.cc:1261] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:04.468182 31312 consensus_queue.cc:1035] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:04.468488 31338 ts_tablet_manager.cc:927] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:10:04.486752 31338 tablet_copy_client.cc:316] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:10:04.489015 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet f23cf6497a87482cb9bd824261ba383f from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:10:04.489738 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet f23cf6497a87482cb9bd824261ba383f from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-f23cf6497a87482cb9bd824261ba383f
I20260807 15:10:04.494081 29561 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:04.499334 31312 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:04.503535 29498 tablet_copy_source_session.cc:205] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:04.509503 31338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23cf6497a87482cb9bd824261ba383f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:04.540665 31312 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.543396 31347 ts_tablet_manager.cc:927] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:04.550621 29637 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.564682 29561 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:04.569837 31338 tablet_copy_client.cc:791] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:04.570549 31338 tablet_copy_client.cc:655] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:04.577257 31338 tablet_copy_client.cc:531] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:04.608547 31347 tablet_copy_client.cc:316] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:10:04.611771 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 0a0ef49386d543e6bf09732d79976e83 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:10:04.612380 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 0a0ef49386d543e6bf09732d79976e83 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-0a0ef49386d543e6bf09732d79976e83
I20260807 15:10:04.630227 29579 tablet_copy_source_session.cc:205] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:04.635725 31338 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:04.670528 31347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a0ef49386d543e6bf09732d79976e83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:04.703506 31338 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:04.707455 31338 tablet_bootstrap.cc:492] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:04.710919 31338 ts_tablet_manager.cc:1397] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.075s user 0.038s sys 0.004s
I20260807 15:10:04.709524 29378 catalog_manager.cc:5495] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:04.713078 31347 tablet_copy_client.cc:791] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:04.713766 31347 tablet_copy_client.cc:655] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:04.717211 31338 raft_consensus.cc:348] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:04.718237 31338 raft_consensus.cc:729] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:04.719000 31338 consensus_queue.cc:260] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:04.729863 31338 ts_tablet_manager.cc:1428] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260807 15:10:04.733580 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-f23cf6497a87482cb9bd824261ba383f received from {username='slave'} at 127.0.0.1:55224
I20260807 15:10:04.734052 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-f23cf6497a87482cb9bd824261ba383f on tablet f23cf6497a87482cb9bd824261ba383f with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:04.745677 31347 tablet_copy_client.cc:531] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:04.755972 31349 ts_tablet_manager.cc:927] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:10:04.764860 31347 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:04.770757 31349 tablet_copy_client.cc:316] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:10:04.776494 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet 3a1d390489b54758a0ce36af133f1d57 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:10:04.777073 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet 3a1d390489b54758a0ce36af133f1d57 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-3a1d390489b54758a0ce36af133f1d57
I20260807 15:10:04.793334 29498 tablet_copy_source_session.cc:205] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:04.797219 31349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1d390489b54758a0ce36af133f1d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:04.810551 31338 ts_tablet_manager.cc:927] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:10:04.822472 31349 tablet_copy_client.cc:791] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:04.823345 31349 tablet_copy_client.cc:655] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:04.829205 31338 tablet_copy_client.cc:316] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:10:04.833069 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet 990a0811150c4c53ae50cc69c71f2926 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:10:04.833696 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet 990a0811150c4c53ae50cc69c71f2926 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-990a0811150c4c53ae50cc69c71f2926
I20260807 15:10:04.832679 31349 tablet_copy_client.cc:531] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:04.849506 29637 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:04.850227 29637 raft_consensus.cc:595] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:04.855173 29483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:04.855876 29483 raft_consensus.cc:595] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:04.860648 29569 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e0c073edf1454d1589526a840754b5da"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:04.861166 29498 tablet_copy_source_session.cc:205] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:04.861251 29569 raft_consensus.cc:595] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:04.863601 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 15:10:04.864758 31338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 990a0811150c4c53ae50cc69c71f2926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:04.870535 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:04.872937 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:04.885278 31314 raft_consensus.cc:979] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:04.888199 31256 raft_consensus.cc:1067] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:04.890236 29487 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e0c073edf1454d1589526a840754b5da"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:04.890926 29487 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:04.891316 29487 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:04.895988 31349 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:04.897816 31347 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:04.902279 31347 tablet_bootstrap.cc:492] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:04.911538 29487 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:04.913565 29487 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:04.914662 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:04.915290 29637 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:04.920931 31347 ts_tablet_manager.cc:1397] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.156s user 0.027s sys 0.030s
I20260807 15:10:04.923403 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:04.924185 29566 raft_consensus.cc:3032] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:04.924540 29566 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:04.911119 31338 tablet_copy_client.cc:791] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:04.926751 29637 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:04.930981 29566 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:04.936017 29449 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:04.936940 31290 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:04.937426 31290 raft_consensus.cc:686] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:04.938263 31290 consensus_queue.cc:237] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:04.940274 29566 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:04.945204 31338 tablet_copy_client.cc:655] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:04.954349 31338 tablet_copy_client.cc:531] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:04.962396 30307 raft_consensus.cc:1203] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20260807 15:10:04.967499 29566 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:04.939585 31347 raft_consensus.cc:348] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:04.968711 31347 raft_consensus.cc:729] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:04.969553 31347 consensus_queue.cc:260] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:04.972898 31347 ts_tablet_manager.cc:1428] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.052s user 0.002s sys 0.007s
I20260807 15:10:04.975674 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-0a0ef49386d543e6bf09732d79976e83 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:10:04.976152 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-0a0ef49386d543e6bf09732d79976e83 on tablet 0a0ef49386d543e6bf09732d79976e83 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:04.979324 31338 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:05.074657 29380 catalog_manager.cc:5495] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 1 to 2, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 2 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:05.092939 31338 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:05.093861 31338 tablet_bootstrap.cc:492] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:05.094098 31349 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:05.094551 31338 ts_tablet_manager.cc:1397] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.115s user 0.021s sys 0.004s
I20260807 15:10:05.095052 31349 tablet_bootstrap.cc:492] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:05.095851 31349 ts_tablet_manager.cc:1397] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.200s user 0.027s sys 0.020s
I20260807 15:10:05.099200 31349 raft_consensus.cc:348] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:05.100250 31349 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:05.098701 31338 raft_consensus.cc:348] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:05.101191 31338 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:05.100946 31349 consensus_queue.cc:260] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:05.101922 31338 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:05.103768 31349 ts_tablet_manager.cc:1428] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260807 15:10:05.107023 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-3a1d390489b54758a0ce36af133f1d57 received from {username='slave'} at 127.0.0.1:55224
I20260807 15:10:05.107501 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-3a1d390489b54758a0ce36af133f1d57 on tablet 3a1d390489b54758a0ce36af133f1d57 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:05.114043 31338 ts_tablet_manager.cc:1428] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.019s user 0.010s sys 0.000s
I20260807 15:10:05.115949 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-990a0811150c4c53ae50cc69c71f2926 received from {username='slave'} at 127.0.0.1:55224
I20260807 15:10:05.116334 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-990a0811150c4c53ae50cc69c71f2926 on tablet 990a0811150c4c53ae50cc69c71f2926 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:05.125524 30307 raft_consensus.cc:1203] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260807 15:10:05.269550 31275 raft_consensus.cc:979] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:05.270303 31275 raft_consensus.cc:1067] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:05.286556 29569 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:05.287223 29569 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:05.287619 29569 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:05.299995 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 54913.6us
I20260807 15:10:05.308493 29569 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:05.310761 29569 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:05.312716 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:05.313469 29487 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:05.322072 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:05.322820 29637 raft_consensus.cc:3032] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:05.323166 29637 raft_consensus.cc:729] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:05.324826 29637 consensus_queue.cc:260] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:05.329236 29637 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:05.330616 29487 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:05.336149 30307 raft_consensus.cc:1203] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:10:05.339002 29637 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:05.340034 29531 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:05.341187 31274 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:05.341691 31274 raft_consensus.cc:686] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:05.342653 31274 consensus_queue.cc:237] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:05.373260 31363 raft_consensus.cc:979] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:05.373884 31337 raft_consensus.cc:1067] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:05.375381 29637 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:05.376039 29637 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:05.376453 29637 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:05.390259 29637 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:05.393101 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:05.393728 29487 raft_consensus.cc:3032] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:05.394001 29487 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:05.394712 29487 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:05.395742 29487 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:05.397078 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:05.397758 29566 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:05.397958 29637 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:05.401237 29380 catalog_manager.cc:5495] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:05.413424 29566 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:05.419852 29487 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:05.421633 29609 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:05.422711 31365 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:05.423306 31365 raft_consensus.cc:686] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:05.432777 31365 consensus_queue.cc:237] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:05.446542 31337 raft_consensus.cc:1050] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:05.449391 31337 consensus_queue.cc:237] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:05.462545 29637 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:05.465292 31363 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:05.464558 29380 catalog_manager.cc:5495] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:05.509982 30312 raft_consensus.cc:1203] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20260807 15:10:05.515443 29566 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:05.530520 31278 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:05.539525 30312 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:05.541289 29646 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:05.541106 31363 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:05.545593 29563 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:05.548635 31363 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:05.575058 31337 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260807 15:10:05.663913 31337 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.678779 31256 raft_consensus.cc:1050] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:05.678557 29569 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.681634 31256 consensus_queue.cc:237] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:05.688474 30312 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.690670 29646 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.707121 29379 catalog_manager.cc:5495] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:05.731267 29487 consensus_queue.cc:237] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:05.744594 29646 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:05.752347 31278 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:05.743297 30312 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:05.768169 31278 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:10:05.768646 29646 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:05.770097 31360 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:05.775627 31312 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.777784 30307 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.783973 29637 raft_consensus.cc:1261] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:05.785861 31360 consensus_queue.cc:1035] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:05.793092 29486 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:05.796530 31360 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:05.783972 30312 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:05.814155 29638 raft_consensus.cc:2932] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.820897 29378 catalog_manager.cc:5495] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 4 to 5, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.829006 31362 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:05.833905 29479 raft_consensus.cc:1261] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:05.843724 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f23cf6497a87482cb9bd824261ba383f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:05.852802 31256 consensus_queue.cc:1035] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:05.853170 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet f23cf6497a87482cb9bd824261ba383f with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52540
I20260807 15:10:05.879701 31386 tablet_replica.cc:330] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:10:05.880064 31337 raft_consensus.cc:1050] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:05.894987 31386 raft_consensus.cc:2229] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:05.896338 31386 raft_consensus.cc:2258] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:05.892756 31337 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:05.910275 31386 ts_tablet_manager.cc:1905] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:05.914534 31362 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.918396 29485 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.923418 29566 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:05.926334 31355 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:05.952909 31386 ts_tablet_manager.cc:1918] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260807 15:10:05.954196 30308 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.957532 29646 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.958818 29378 catalog_manager.cc:5495] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:05.964401 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:05.969321 31386 log.cc:1196] T f23cf6497a87482cb9bd824261ba383f P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/f23cf6497a87482cb9bd824261ba383f
I20260807 15:10:05.972579 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet f23cf6497a87482cb9bd824261ba383f (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:05.999917 29638 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:06.003033 31337 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:06.006208 29561 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:06.007721 29483 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:05.998579 30308 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:06.024128 31366 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260807 15:10:06.044279 31361 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:06.049664 31312 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:06.057104 29561 consensus_queue.cc:237] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:06.083082 29487 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:06.087939 30308 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:06.092864 31364 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:06.094797 31274 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:06.097196 29638 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:06.098382 29638 raft_consensus.cc:595] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:06.107692 29485 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:06.108560 29485 raft_consensus.cc:595] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:06.115311 31278 raft_consensus.cc:1050] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:06.119868 31278 consensus_queue.cc:237] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:06.137563 31314 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.140960 29569 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:06.143472 29569 raft_consensus.cc:595] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:06.151962 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 15:10:06.153646 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:06.154417 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:06.155608 31337 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.161453 30308 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.168821 30307 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.162209 29486 raft_consensus.cc:2932] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.185185 29378 catalog_manager.cc:5495] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 4 to 5, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:06.208961 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 0a0ef49386d543e6bf09732d79976e83 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:06.215552 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a0ef49386d543e6bf09732d79976e83 with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46792
I20260807 15:10:06.230608 29569 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.202492 29646 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.286638 30308 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:06.286777 29640 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:06.288990 31290 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:10:06.292290 31337 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260807 15:10:06.295310 29379 catalog_manager.cc:5495] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.290468 31397 tablet_replica.cc:330] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:10:06.310323 29561 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:06.321241 31290 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:06.356755 31355 raft_consensus.cc:979] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:06.357609 31365 raft_consensus.cc:1067] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:06.360150 29563 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:06.361084 29563 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:06.361655 29563 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:06.406632 31337 raft_consensus.cc:979] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:06.406466 31397 raft_consensus.cc:2229] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:06.407761 31363 raft_consensus.cc:1067] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:06.408743 31397 raft_consensus.cc:2258] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:06.412278 29640 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:06.412923 29640 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:06.413288 29640 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:06.418234 29483 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:06.434096 30308 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:10:06.437220 29563 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:06.437772 29637 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:10:06.439452 29563 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:06.440325 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 58444us
I20260807 15:10:06.440590 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:06.441207 29643 raft_consensus.cc:3032] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:06.441490 29643 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:06.439698 31397 ts_tablet_manager.cc:1905] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:06.442303 29643 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:06.445081 29643 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:06.447829 29640 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:06.451016 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:06.452872 29640 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:06.454605 29486 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:06.458185 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:06.458880 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:06.459214 29563 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:06.459596 29483 raft_consensus.cc:3032] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:06.459985 29483 raft_consensus.cc:729] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:06.460822 29483 consensus_queue.cc:260] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:06.462172 29483 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:06.469936 29486 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:06.471096 29563 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:06.471446 29533 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:06.472721 29608 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:06.446563 31278 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:06.482368 29643 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:06.488129 29483 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:06.484026 31256 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
W20260807 15:10:06.522513 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 76256.6us
I20260807 15:10:06.522987 31365 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:06.491932 31337 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260807 15:10:06.544948 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 98025.1us
I20260807 15:10:06.548770 31274 raft_consensus.cc:979] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:06.555069 31256 raft_consensus.cc:686] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:06.556691 31256 consensus_queue.cc:237] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:06.558435 31274 raft_consensus.cc:1067] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
W20260807 15:10:06.563691 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 44045.6us
I20260807 15:10:06.551380 31365 raft_consensus.cc:686] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:10:06.583655 31399 log.cc:924] Time spent T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.174s user 0.002s sys 0.000s
W20260807 15:10:06.598526 31401 log.cc:924] Time spent T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20260807 15:10:06.568499 31365 consensus_queue.cc:237] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:06.638849 29646 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.637049 31361 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.682514 30312 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.726044 29483 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:06.726734 29483 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:06.727123 29483 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:06.732896 31397 ts_tablet_manager.cc:1918] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260807 15:10:06.733536 31397 log.cc:1196] T 0a0ef49386d543e6bf09732d79976e83 P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/0a0ef49386d543e6bf09732d79976e83
I20260807 15:10:06.752156 29483 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:06.754215 29483 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:06.776911 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 304292us
W20260807 15:10:06.802189 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 74019.9us
I20260807 15:10:06.796633 29378 catalog_manager.cc:5495] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.653440 31337 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:06.815960 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:06.816784 29643 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:06.823661 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 110168us
I20260807 15:10:06.827000 29379 catalog_manager.cc:5495] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:06.840091 29643 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:06.840721 29640 raft_consensus.cc:1226] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:06.843472 29380 catalog_manager.cc:5495] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
W20260807 15:10:06.858742 31418 log.cc:924] Time spent T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
I20260807 15:10:06.872427 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet 0a0ef49386d543e6bf09732d79976e83 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
W20260807 15:10:06.922637 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 99554.9us
W20260807 15:10:06.918315 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 199608us
W20260807 15:10:06.944756 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 131505us
W20260807 15:10:07.059372 31423 log.cc:924] Time spent T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.109s user 0.001s sys 0.000s
I20260807 15:10:07.060894 31425 consensus_queue.cc:1046] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260807 15:10:07.062578 31362 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:07.063066 31362 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:07.063954 31362 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:07.065649 31362 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:07.067441 30312 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:07.071020 29449 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:07.074970 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 130712us
I20260807 15:10:07.088901 29382 catalog_manager.cc:5495] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:07.093302 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:07.105852 29479 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:07.111840 31256 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 15:10:07.131211 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 54175.1us
I20260807 15:10:07.142765 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 990a0811150c4c53ae50cc69c71f2926 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260807 15:10:07.155306 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 84398.2us
I20260807 15:10:07.163596 31434 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
W20260807 15:10:07.188895 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 46943.9us
I20260807 15:10:07.197002 29643 raft_consensus.cc:2932] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:07.214619 31434 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:10:07.235277 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 47613.5us
I20260807 15:10:07.243096 31434 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:07.248994 29565 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:07.257993 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 124355us
I20260807 15:10:07.272174 29566 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:07.292330 29561 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:07.311128 29646 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:07.376060 29487 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:07.377929 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet 990a0811150c4c53ae50cc69c71f2926 with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:10:07.386039 31407 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:07.410538 31362 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:07.459754 31416 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260807 15:10:07.506145 31450 tablet_replica.cc:330] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:10:07.516800 31450 raft_consensus.cc:2229] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:07.517879 31450 raft_consensus.cc:2258] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:07.539837 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:07.534837 29378 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:07.598759 31450 ts_tablet_manager.cc:1905] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:07.600253 29487 consensus_queue.cc:237] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:07.617224 30308 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:07.624372 31312 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:07.628566 29566 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:07.650751 31436 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:07.653779 29565 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:07.657428 29565 raft_consensus.cc:595] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:10:07.668305 30308 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:07.688972 31430 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:07.697850 29566 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:07.698443 29565 raft_consensus.cc:2932] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:07.701701 29566 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:07.702309 29566 raft_consensus.cc:595] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:07.706112 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:07.706821 29646 raft_consensus.cc:595] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:07.707105 31278 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:07.713066 29638 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:07.714037 29638 raft_consensus.cc:595] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:07.720649 29637 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:07.725421 31278 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:07.730921 29379 catalog_manager.cc:5495] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 5 to 6, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:07.754868 29483 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:07.755610 29483 raft_consensus.cc:595] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:07.762096 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 3a1d390489b54758a0ce36af133f1d57 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:07.769439 31416 raft_consensus.cc:979] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:07.769984 31416 raft_consensus.cc:1067] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:07.773742 29486 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:07.774523 29486 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:07.774976 29486 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:07.769512 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 15:10:07.794073 29486 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:07.795182 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a1d390489b54758a0ce36af133f1d57 with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46792
I20260807 15:10:07.811918 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:07.812727 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:07.815438 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:07.816610 29646 raft_consensus.cc:3032] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:07.817857 29646 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:07.818572 29486 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:07.826256 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:07.826881 30308 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:07.829865 29646 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:07.831202 29646 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:07.849134 30308 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:07.850669 29452 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:07.861991 29646 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:07.869513 31361 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:07.899286 31462 tablet_replica.cc:330] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:10:07.904745 31462 raft_consensus.cc:2229] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:07.906069 31462 raft_consensus.cc:2258] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:07.910774 31360 raft_consensus.cc:979] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:10:07.911348 31360 raft_consensus.cc:1067] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:10:07.919668 31450 ts_tablet_manager.cc:1918] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:10:07.919705 30308 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48584
I20260807 15:10:07.920430 31450 log.cc:1196] T 990a0811150c4c53ae50cc69c71f2926 P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/990a0811150c4c53ae50cc69c71f2926
I20260807 15:10:07.920570 30308 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:07.922930 30308 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:07.934705 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet 990a0811150c4c53ae50cc69c71f2926 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
W20260807 15:10:07.938566 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 47714.3us
I20260807 15:10:07.939411 30308 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:07.945773 31446 log.cc:924] Time spent T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.068s user 0.003s sys 0.000s
I20260807 15:10:07.957067 31462 ts_tablet_manager.cc:1905] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:07.964689 31406 raft_consensus.cc:979] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:07.965301 31406 raft_consensus.cc:1067] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:07.970247 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:07.970587 30308 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:07.958760 31361 raft_consensus.cc:686] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:07.970958 29479 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:07.971465 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:07.972036 29566 raft_consensus.cc:3032] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:07.972311 29566 raft_consensus.cc:729] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:07.973111 29566 consensus_queue.cc:260] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:07.974010 29566 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:07.981669 31361 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:07.983986 29486 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:07.984558 29486 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:07.984871 29486 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:07.990855 29566 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:07.991598 29486 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:07.995513 29486 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:07.996085 29479 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:07.998589 30274 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:07.999511 31404 raft_consensus.cc:2781] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:08.000017 31404 raft_consensus.cc:686] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:08.000872 31404 consensus_queue.cc:237] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:08.002014 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:08.002638 29561 raft_consensus.cc:3032] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:08.002930 29561 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:08.003635 29561 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:08.005728 29561 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:08.009500 31466 raft_consensus.cc:979] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:08.010138 31466 raft_consensus.cc:1067] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:08.011701 29643 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:08.036844 29379 catalog_manager.cc:5495] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 2 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:08.045436 29382 catalog_manager.cc:5495] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 3 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:08.076359 31462 ts_tablet_manager.cc:1918] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260807 15:10:08.076910 31462 log.cc:1196] T 3a1d390489b54758a0ce36af133f1d57 P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/3a1d390489b54758a0ce36af133f1d57
I20260807 15:10:08.004529 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:08.085719 30308 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:08.090452 29643 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:08.091106 29643 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:08.101768 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet 3a1d390489b54758a0ce36af133f1d57 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:08.110041 30308 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:08.111616 29452 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:08.112900 31278 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:08.113391 31278 raft_consensus.cc:686] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:08.114259 31278 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:08.115689 31428 raft_consensus.cc:979] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:08.116168 31428 raft_consensus.cc:1067] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:08.118062 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:08.118614 29566 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:08.118965 29566 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:08.128062 29561 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:08.127800 29566 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:08.144273 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:08.144928 29637 raft_consensus.cc:3032] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:08.145229 29637 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:08.145934 29637 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:08.139258 29643 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:08.147017 29637 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:08.149039 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:08.149191 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:08.149637 30308 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:08.149825 29479 raft_consensus.cc:3032] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:08.150188 29479 raft_consensus.cc:729] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:08.150931 29479 consensus_queue.cc:260] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:08.152176 29479 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:08.153554 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:08.154562 29561 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:08.156497 29643 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:08.161358 30308 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:08.144449 29566 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:08.177806 29533 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:08.179231 31314 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:08.179806 31314 raft_consensus.cc:686] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:08.181545 31314 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:08.182897 29479 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:08.188077 29609 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:08.190681 29637 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:08.191126 31444 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:08.191636 31444 raft_consensus.cc:686] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:08.192580 31444 consensus_queue.cc:237] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:08.193761 29379 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:08.201160 29561 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:08.242162 29379 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:08.248181 29382 catalog_manager.cc:5495] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 3, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:08.472795 29561 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:08.475477 31250 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:08.477738 29637 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:08.479423 31278 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:08.529688 30308 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:08.531386 31278 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:08.554149 29486 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:08.570031 29561 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:08.564788 31250 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:08.576429 31278 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:08.587589 30308 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:08.594378 31278 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:08.612097 29643 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:08.614261 31314 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260807 15:10:08.619568 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 57140.5us
W20260807 15:10:08.639623 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 45620.1us
W20260807 15:10:08.767272 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 70590.3us
W20260807 15:10:08.803680 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 92648.4us
I20260807 15:10:08.820139 29565 raft_consensus.cc:1261] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260807 15:10:08.824662 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 55304us
I20260807 15:10:08.839262 30312 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:08.851935 31413 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 15:10:08.892437 31497 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260807 15:10:08.890717 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:10:08.978075 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 69412.1us
I20260807 15:10:09.111299 29486 raft_consensus.cc:1261] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:09.179144 31444 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:09.281116 29565 consensus_queue.cc:237] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:10:09.293238 29533 consensus_peers.cc:487] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fd4d41c286445e997322bdb49e97c65. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:09.294649 29640 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:09.296325 31497 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:09.297151 29486 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:09.299115 31506 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:09.301820 29486 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "27275fe691bf4c42814ccca06801b625"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:09.302750 29486 raft_consensus.cc:595] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:09.310205 29565 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:09.310915 29565 raft_consensus.cc:595] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:09.312110 31408 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:09.320279 29481 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:09.326653 29637 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:09.343161 31278 raft_consensus.cc:979] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:09.343842 31278 raft_consensus.cc:1067] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:09.348531 29486 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:09.349454 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "27275fe691bf4c42814ccca06801b625"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:10:09.355964 29566 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:09.355270 29379 catalog_manager.cc:5495] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:09.356530 29566 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:09.364048 29640 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:09.366782 29640 raft_consensus.cc:595] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:09.375464 29481 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e0c073edf1454d1589526a840754b5da"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:09.378077 29481 raft_consensus.cc:595] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:09.380342 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260807 15:10:09.381688 29452 consensus_peers.cc:487] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c235e827abcd4d26adef777f50f15d3e. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:09.382355 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:09.383219 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:09.372871 29566 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:09.384790 29565 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:09.386782 31504 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:09.387338 29637 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:09.389128 31496 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:09.391772 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:09.392552 29481 raft_consensus.cc:3032] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:09.392289 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:09.393095 29481 raft_consensus.cc:729] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:09.393395 29643 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:09.394497 29481 consensus_queue.cc:260] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:09.475522 29643 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:09.569314 29566 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:09.571105 29481 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:09.586259 29531 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:09.589025 31509 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:09.589632 31509 raft_consensus.cc:686] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:09.590761 31509 consensus_queue.cc:237] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:09.622115 29481 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
W20260807 15:10:09.721673 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 49341.4us
W20260807 15:10:09.732792 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 47842.4us
W20260807 15:10:09.736434 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 49514.3us
W20260807 15:10:09.773618 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 45477.9us
I20260807 15:10:09.763655 29640 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:09.786162 31528 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:09.849951 31551 ts_tablet_manager.cc:927] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:10:09.851563 29378 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:09.852715 31532 raft_consensus.cc:979] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:09.855137 31532 raft_consensus.cc:1067] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:09.854815 29566 consensus_queue.cc:237] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:09.899878 29486 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:09.900964 29486 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:09.901423 29486 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:09.913650 31504 raft_consensus.cc:979] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:09.914485 31486 raft_consensus.cc:1067] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:09.920070 29382 catalog_manager.cc:5495] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:09.936061 31551 tablet_copy_client.cc:316] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.193:39125
I20260807 15:10:09.938845 29486 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:09.941741 29486 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:09.970023 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:09.970742 29640 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:09.971046 29640 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:09.972031 29640 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:09.973703 29640 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:09.980697 29645 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:09.985720 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:09.986384 30312 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:09.987680 31497 raft_consensus.cc:979] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:09.988335 31497 raft_consensus.cc:1067] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:09.993633 31497 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:09.996222 29637 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:10:09.996901 29637 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:09.997247 29637 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:09.998715 31554 ts_tablet_manager.cc:927] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:10.006191 29637 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:10.008399 29637 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:09.996467 30312 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:10.009651 29640 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:10.010138 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:10.010967 29566 raft_consensus.cc:3032] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:10.011159 29449 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:10.011358 29566 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:10.012526 31504 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:10.013075 31504 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:10.014163 31504 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:10.019012 29565 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e0c073edf1454d1589526a840754b5da"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:10:10.019754 29565 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:10.020121 29498 tablet_copy_service.cc:140] P 9bbe5c211ab64989a57350f34f007ced: Received BeginTabletCopySession request for tablet c235e827abcd4d26adef777f50f15d3e from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:55224)
I20260807 15:10:10.019181 29568 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:10.020812 29498 tablet_copy_service.cc:161] P 9bbe5c211ab64989a57350f34f007ced: Beginning new tablet copy session on tablet c235e827abcd4d26adef777f50f15d3e from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:55224: session id = fbf78964d70448269802ac7de9d7a198-c235e827abcd4d26adef777f50f15d3e
I20260807 15:10:10.020216 29565 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:10.028029 29566 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:10.029331 29566 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:10.039403 29486 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:10.040721 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:10.079324 29566 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:10.095317 29565 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:10.098337 31406 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:10.103611 29608 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:10.105504 31530 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:10.105988 31530 raft_consensus.cc:686] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:10.106926 31530 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:10.109826 29498 tablet_copy_source_session.cc:205] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:10.114544 31551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c235e827abcd4d26adef777f50f15d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:10.085758 29382 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 4 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:10.116868 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:10.117831 29486 raft_consensus.cc:3032] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:10.118171 29486 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:10.119230 29486 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:10.124369 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:10.124151 31497 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:10.129000 29565 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:10.138170 29645 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:10.129763 31554 tablet_copy_client.cc:316] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:10:10.132191 29643 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:10.136719 29486 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:10.140956 29533 consensus_peers.cc:487] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f248aa577ff4c798c99df5834ea66e5. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:10.146198 29645 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:10.152935 29486 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:10.162989 29378 catalog_manager.cc:5495] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:10.165470 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 5fd4d41c286445e997322bdb49e97c65 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:10:10.166141 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 5fd4d41c286445e997322bdb49e97c65 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-5fd4d41c286445e997322bdb49e97c65
I20260807 15:10:10.166852 29533 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:10.170588 31406 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:10.171108 31406 raft_consensus.cc:686] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:10.179436 29560 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:10.181576 29579 tablet_copy_source_session.cc:205] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:10.188742 31554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fd4d41c286445e997322bdb49e97c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:10.177415 31406 consensus_queue.cc:237] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:10.241808 29379 catalog_manager.cc:5495] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:10.251252 29643 raft_consensus.cc:1261] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:10.280798 31542 consensus_queue.cc:1035] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260807 15:10:10.285115 31551 tablet_copy_client.cc:791] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:10.292750 29645 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:10.295156 31551 tablet_copy_client.cc:655] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:10.288976 29485 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
W20260807 15:10:10.298923 29533 consensus_peers.cc:487] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 030a7060e7f744ff9a4e02ea0cd710bd. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:10.299721 29486 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:10.309432 31314 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:10.328330 29382 catalog_manager.cc:5495] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 3, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:10.329691 31545 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260807 15:10:10.332109 31551 tablet_copy_client.cc:531] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:10.350447 29485 raft_consensus.cc:1261] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:10.352912 31509 consensus_queue.cc:1035] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 15:10:10.358299 31554 tablet_copy_client.cc:791] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:10.359017 31554 tablet_copy_client.cc:655] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:10.366904 31551 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:10.364949 31406 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:10.379376 29486 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:10.388607 29637 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:10.397778 31554 tablet_copy_client.cc:531] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:10.413265 29382 catalog_manager.cc:5495] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index -1 to 4, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:10.469142 31551 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:10.470261 31551 tablet_bootstrap.cc:492] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:10.471181 31551 ts_tablet_manager.cc:1397] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.105s user 0.028s sys 0.005s
I20260807 15:10:10.474638 31551 raft_consensus.cc:348] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:10.475762 31551 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:10.476579 31551 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:10.480535 31554 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:10.481635 31551 ts_tablet_manager.cc:1428] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.010s user 0.003s sys 0.003s
I20260807 15:10:10.483379 29498 tablet_copy_service.cc:342] P 9bbe5c211ab64989a57350f34f007ced: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-c235e827abcd4d26adef777f50f15d3e received from {username='slave'} at 127.0.0.1:55224
I20260807 15:10:10.483819 29498 tablet_copy_service.cc:433] P 9bbe5c211ab64989a57350f34f007ced: ending tablet copy session fbf78964d70448269802ac7de9d7a198-c235e827abcd4d26adef777f50f15d3e on tablet c235e827abcd4d26adef777f50f15d3e with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:10.489310 31551 ts_tablet_manager.cc:927] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:10.500947 31551 tablet_copy_client.cc:316] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:10:10.527937 29645 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:10.529712 31278 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:10:10.680173 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 8f248aa577ff4c798c99df5834ea66e5 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:10:10.680785 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 8f248aa577ff4c798c99df5834ea66e5 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-8f248aa577ff4c798c99df5834ea66e5
I20260807 15:10:10.690069 29579 tablet_copy_source_session.cc:205] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:10.690562 31554 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:10.695096 31554 tablet_bootstrap.cc:492] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:10.696223 31554 ts_tablet_manager.cc:1397] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.216s user 0.045s sys 0.032s
I20260807 15:10:10.700225 30311 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:10.705602 29565 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:10.709381 30311 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:10.710868 31554 raft_consensus.cc:348] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:10.716135 31554 raft_consensus.cc:729] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:10.716946 31554 consensus_queue.cc:260] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:10.724396 31550 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:10.742906 31551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f248aa577ff4c798c99df5834ea66e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:10.751019 30308 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:10.755568 31554 ts_tablet_manager.cc:1428] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.059s user 0.004s sys 0.002s
I20260807 15:10:10.759120 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-5fd4d41c286445e997322bdb49e97c65 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:10:10.759554 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-5fd4d41c286445e997322bdb49e97c65 on tablet 5fd4d41c286445e997322bdb49e97c65 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:10.769598 31550 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:10.772643 31551 tablet_copy_client.cc:791] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:10.773406 31551 tablet_copy_client.cc:655] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:10.773540 31504 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:10.803756 29637 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:10.825723 29485 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:10.840848 31545 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:10.844419 31314 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:10.853193 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:10.884881 31554 ts_tablet_manager.cc:927] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:10.882786 31551 tablet_copy_client.cc:531] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:10.901539 30307 raft_consensus.cc:1203] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:10:10.916574 31554 tablet_copy_client.cc:316] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:10:10.987133 30310 raft_consensus.cc:1203] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20260807 15:10:11.036109 29565 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:11.036950 29565 raft_consensus.cc:595] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:11.043987 29565 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:11.044656 29565 raft_consensus.cc:595] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:11.049252 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 127765us
I20260807 15:10:11.121958 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 030a7060e7f744ff9a4e02ea0cd710bd from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:10:11.122740 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 030a7060e7f744ff9a4e02ea0cd710bd from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-030a7060e7f744ff9a4e02ea0cd710bd
W20260807 15:10:11.215088 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 49033.3us
W20260807 15:10:11.218215 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 82887.6us
I20260807 15:10:11.239735 29579 tablet_copy_source_session.cc:205] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:11.239995 31551 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:11.248018 31554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 030a7060e7f744ff9a4e02ea0cd710bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 15:10:11.329977 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 310218us
I20260807 15:10:11.377957 31545 raft_consensus.cc:979] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:11.378481 31545 raft_consensus.cc:1067] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:11.384835 29637 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:11.385488 29637 raft_consensus.cc:595] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:11.390882 29646 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:10:11.391572 29646 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:11.391960 29646 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:11.396090 31278 raft_consensus.cc:1050] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:11.401121 31278 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:11.406206 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 46542.1us
I20260807 15:10:11.421638 29646 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:11.450234 29646 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:11.514667 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 61411.6us
W20260807 15:10:11.546247 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 96448.7us
I20260807 15:10:11.633270 30312 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:11.642180 29646 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:11.663231 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:11.664000 29479 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:11.668551 31545 raft_consensus.cc:1050] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:11.682252 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:11.682845 31554 tablet_copy_client.cc:791] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:11.683002 29564 raft_consensus.cc:3032] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:11.683334 29564 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:11.683517 31554 tablet_copy_client.cc:655] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:11.685479 29564 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:11.686713 29564 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:11.697347 29564 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:11.698884 29560 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:11.699970 29479 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:11.701258 31601 raft_consensus.cc:979] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:11.701959 31509 raft_consensus.cc:1067] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:11.671275 31545 consensus_queue.cc:237] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:11.719776 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 56797us
W20260807 15:10:11.724704 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50315.5us
I20260807 15:10:11.729373 31602 raft_consensus.cc:979] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:11.730512 29609 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:11.732043 31599 raft_consensus.cc:1067] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:11.733727 31604 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:11.735327 31587 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:11.735926 31587 raft_consensus.cc:686] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:11.743909 31587 consensus_queue.cc:237] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:11.747076 31598 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:11.750486 31598 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:11.774326 29479 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:11.774495 29568 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:11.775012 29479 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:11.775252 29568 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:11.775499 29479 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:11.775708 29568 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:11.780741 31554 tablet_copy_client.cc:531] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:11.788221 29486 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:11.788862 29486 raft_consensus.cc:595] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:11.793001 31598 raft_consensus.cc:979] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:11.794112 31598 raft_consensus.cc:1067] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:11.804589 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 15:10:11.807061 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:11.807828 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:11.817430 29643 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:11.818154 29643 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:11.818660 29643 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:11.791750 29479 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:11.825793 29568 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:11.831664 29643 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:11.819718 31551 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:11.837716 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:11.838187 29479 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:11.838389 29568 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:11.838548 29637 raft_consensus.cc:3032] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:11.838920 29637 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:11.839151 29643 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:11.839709 29637 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:11.852916 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:11.853816 29483 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:11.854210 29483 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:11.856664 29638 raft_consensus.cc:1226] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:11.863849 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:11.864660 29646 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:11.855136 29483 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:11.867441 29483 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:11.852983 31551 tablet_bootstrap.cc:492] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:11.881114 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:11.881687 29568 raft_consensus.cc:3032] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:11.881965 29568 raft_consensus.cc:729] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:11.876534 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:11.889142 30307 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:11.882606 29568 consensus_queue.cc:260] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:11.904523 29568 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:11.905704 29564 raft_consensus.cc:1226] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:11.908432 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:11.909256 30306 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:11.911036 31554 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:11.955032 29568 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:11.955741 29646 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:11.957414 29643 raft_consensus.cc:1226] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:11.904199 31551 ts_tablet_manager.cc:1397] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.664s user 0.028s sys 0.016s
I20260807 15:10:11.959528 29449 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:11.949523 30307 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
W20260807 15:10:11.990105 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 94083.9us
W20260807 15:10:11.993086 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 96333.6us
I20260807 15:10:11.994146 29483 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:11.997882 29533 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:11.997618 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:12.008689 31592 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:12.009351 31592 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:12.010581 30306 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:12.010416 31592 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:12.001631 31497 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:12.013010 31497 raft_consensus.cc:686] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:12.032516 29644 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:12.014678 31497 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:12.032388 31594 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
W20260807 15:10:12.087491 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 73993.3us
I20260807 15:10:12.104375 30312 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:12.080308 31594 raft_consensus.cc:686] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:12.106206 31594 consensus_queue.cc:237] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:12.107824 29382 catalog_manager.cc:5495] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:12.108311 31598 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:12.259112 29637 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:12.300134 30312 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:12.305737 31551 raft_consensus.cc:348] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:12.321677 31551 raft_consensus.cc:729] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:12.322398 31551 consensus_queue.cc:260] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:10:12.349498 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 87618.8us
I20260807 15:10:12.365217 29637 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:12.315570 31497 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260807 15:10:12.402024 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 46481.1us
I20260807 15:10:12.405002 29637 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:12.424088 29485 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:12.429221 29564 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:12.454051 29378 catalog_manager.cc:5495] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260807 15:10:12.468706 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 70649.2us
W20260807 15:10:12.510316 31619 log.cc:924] Time spent T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.079s user 0.000s sys 0.001s
I20260807 15:10:12.514394 31551 ts_tablet_manager.cc:1428] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.551s user 0.010s sys 0.023s
W20260807 15:10:12.515378 31551 ts_tablet_manager.cc:1460] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Tablet startup took 553ms
W20260807 15:10:12.557056 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 118159us
W20260807 15:10:12.558988 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 129141us
I20260807 15:10:12.578034 31592 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260807 15:10:12.576128 31617 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.177s
W20260807 15:10:12.649349 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 63408.5us
W20260807 15:10:12.661070 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 191623us
W20260807 15:10:12.662689 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 96199.9us
I20260807 15:10:12.670989 29483 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260807 15:10:12.515949 31551 ts_tablet_manager.cc:1462] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Trace:
0807 15:10:10.448479 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:10.448623 (+ 144us) service_pool.cc:227] Handling call
0807 15:10:10.489784 (+ 41161us) ts_tablet_manager.cc:928] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
0807 15:10:10.741569 (+251785us) tablet_copy_client.cc:361] Tablet copy session begun
0807 15:10:10.754989 (+ 13420us) tablet_metadata.cc:641] Metadata flushed
0807 15:10:10.755272 (+ 283us) tablet_copy_client.cc:490] Wrote new tablet metadata
0807 15:10:10.771740 (+ 16468us) tablet_copy_client.cc:411] Wrote new consensus metadata
0807 15:10:10.772085 (+ 345us) tablet_replica.cc:205] Creating consensus instance
0807 15:10:10.772417 (+ 332us) ts_tablet_manager.cc:983] Replica registered.
0807 15:10:10.772479 (+ 62us) inbound_call.cc:173] Queueing success response
0807 15:10:11.239541 (+467062us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 15:10:11.966716 (+727175us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 15:10:12.042060 (+ 75344us) tablet_replica.cc:259] Starting instrumentation
0807 15:10:12.092854 (+ 50794us) tablet_replica.cc:278] Starting consensus
Metrics: {"dns_us":240,"mutex_wait_us":31625,"raft.queue_time_us":66357,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":11426,"tablet-copy.queue_time_us":40239,"tablet-download-pool.queue_time_us":126,"tablet-download-pool.run_cpu_time_us":1205,"tablet-download-pool.run_wall_time_us":96221,"thread_start_us":102724,"threads_started":2}
I20260807 15:10:12.684991 30310 raft_consensus.cc:1203] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:10:12.705979 31508 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 15:10:12.714278 29379 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:12.716037 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 53595.6us
I20260807 15:10:12.722527 29380 catalog_manager.cc:5495] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:12.742144 29560 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:12.812772 29566 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:12.822073 30312 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:12.825358 29487 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:12.828200 31508 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260807 15:10:12.831521 31486 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:12.832551 31486 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:12.833235 31549 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260807 15:10:12.849819 29643 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:12.900957 31486 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:13.022997 29382 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 312) took 1163 ms. Trace:
W20260807 15:10:13.176573 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 76850.7us
I20260807 15:10:13.196010 29646 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:13.207479 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:13.220235 31406 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260807 15:10:13.303215 31647 log.cc:924] Time spent T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.073s user 0.000s sys 0.001s
I20260807 15:10:13.305166 31406 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:13.306119 31406 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:13.023555 29382 rpcz_store.cc:276] 0807 15:10:11.859926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:11.860032 (+ 106us) service_pool.cc:227] Handling call
0807 15:10:13.022903 (+1162871us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:12.370725 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:12.371660 (+ 935us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:12.371729 (+ 69us) write_op.cc:435] Acquired schema lock
0807 15:10:12.371758 (+ 29us) tablet.cc:660] Decoding operations
0807 15:10:12.372305 (+ 547us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:12.372435 (+ 130us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:12.372480 (+ 45us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:10:12.372906 (+ 426us) tablet.cc:699] Row locks acquired
0807 15:10:12.372937 (+ 31us) write_op.cc:260] PREPARE: finished
0807 15:10:12.373430 (+ 493us) write_op.cc:270] Start()
0807 15:10:12.373594 (+ 164us) write_op.cc:276] Timestamp: P: 1786115412373090 usec, L: 0
0807 15:10:12.373631 (+ 37us) op_driver.cc:331] REPLICATION: starting
0807 15:10:12.374982 (+ 1351us) log.cc:842] Serialized 544 byte log entry
0807 15:10:12.753206 (+378224us) op_driver.cc:444] REPLICATION: finished
0807 15:10:12.823778 (+ 70572us) write_op.cc:301] APPLY: starting
0807 15:10:12.842882 (+ 19104us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:12.845349 (+ 2467us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:12.906253 (+ 60904us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:12.907396 (+ 1143us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:12.925486 (+ 18090us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:10:12.925635 (+ 149us) write_op.cc:312] APPLY: finished
0807 15:10:12.926073 (+ 438us) log.cc:842] Serialized 23 byte log entry
0807 15:10:12.948288 (+ 22215us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:12.966378 (+ 18090us) write_op.cc:454] Released schema lock
0807 15:10:12.973336 (+ 6958us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":41629,"apply.run_wall_time_us":230484,"num_ops":1,"prepare.queue_time_us":255874,"prepare.run_cpu_time_us":27305,"prepare.run_wall_time_us":68367,"raft.queue_time_us":208095,"raft.run_cpu_time_us":10580,"raft.run_wall_time_us":194730,"replication_time_us":379397,"spinlock_wait_cycles":8433920,"thread_start_us":517532,"threads_started":4,"wal-append.queue_time_us":99845}]]}
I20260807 15:10:13.299454 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-8f248aa577ff4c798c99df5834ea66e5 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:10:13.335578 30307 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:13.295038 31636 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260807 15:10:13.344314 31554 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:13.338447 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-8f248aa577ff4c798c99df5834ea66e5 on tablet 8f248aa577ff4c798c99df5834ea66e5 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:13.352496 31554 tablet_bootstrap.cc:492] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:13.375844 31642 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 15:10:13.389227 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 179193us
I20260807 15:10:13.369181 31554 ts_tablet_manager.cc:1397] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 1.459s user 0.038s sys 0.041s
W20260807 15:10:13.398840 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 168840us
I20260807 15:10:13.402899 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:13.407701 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 77058.3us
I20260807 15:10:13.412891 31314 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260807 15:10:13.415541 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 100559us
W20260807 15:10:13.465175 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 48572.2us
W20260807 15:10:13.467789 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 55776.4us
W20260807 15:10:13.469614 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 69867.3us
W20260807 15:10:13.470485 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 134913us
I20260807 15:10:13.468847 31546 raft_consensus.cc:1050] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
W20260807 15:10:13.492944 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 84509.2us
I20260807 15:10:13.485981 31406 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:13.525053 31658 log.cc:924] Time spent T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.060s user 0.000s sys 0.001s
W20260807 15:10:13.545773 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 53262.2us
W20260807 15:10:13.553164 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 96331.9us
W20260807 15:10:13.559401 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 148491us
I20260807 15:10:13.520709 31496 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260807 15:10:13.569231 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:13.585101 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:13.593950 31546 consensus_queue.cc:237] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:13.597127 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 98776.7us
I20260807 15:10:13.600455 29380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 308) took 1027 ms. Trace:
W20260807 15:10:13.714242 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 117524us
W20260807 15:10:13.715377 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 110191us
W20260807 15:10:13.722397 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 145874us
W20260807 15:10:13.757833 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 181832us
W20260807 15:10:13.786298 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 186638us
I20260807 15:10:13.600967 29380 rpcz_store.cc:276] 0807 15:10:12.572564 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:12.601544 (+ 28980us) service_pool.cc:227] Handling call
0807 15:10:13.600365 (+998821us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:12.769830 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:12.770779 (+ 949us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:12.770834 (+ 55us) write_op.cc:435] Acquired schema lock
0807 15:10:12.770850 (+ 16us) tablet.cc:660] Decoding operations
0807 15:10:12.771381 (+ 531us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:12.771450 (+ 69us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:12.771509 (+ 59us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:10:12.771806 (+ 297us) tablet.cc:699] Row locks acquired
0807 15:10:12.771863 (+ 57us) write_op.cc:260] PREPARE: finished
0807 15:10:12.772150 (+ 287us) write_op.cc:270] Start()
0807 15:10:12.772413 (+ 263us) write_op.cc:276] Timestamp: P: 1786115412772101 usec, L: 0
0807 15:10:12.772461 (+ 48us) op_driver.cc:331] REPLICATION: starting
0807 15:10:13.057949 (+285488us) log.cc:842] Serialized 544 byte log entry
0807 15:10:13.095228 (+ 37279us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc0198 00007f94df7d3ade 00007f94df7d32b8 00007f94df7d7ba1 00007f94df7d7b59 00007f94df7d7ae9 00007f94df7d7ab1 00007f94df7d6dad 00007f94e2100204 00007f94e2100039
0807 15:10:13.441054 (+345826us) op_driver.cc:444] REPLICATION: finished
0807 15:10:13.466182 (+ 25128us) write_op.cc:301] APPLY: starting
0807 15:10:13.469218 (+ 3036us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:13.474206 (+ 4988us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:13.475251 (+ 1045us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:13.493395 (+ 18144us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:13.493560 (+ 165us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:10:13.493611 (+ 51us) write_op.cc:312] APPLY: finished
0807 15:10:13.495319 (+ 1708us) log.cc:842] Serialized 23 byte log entry
0807 15:10:13.495468 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:13.495545 (+ 77us) write_op.cc:454] Released schema lock
0807 15:10:13.495582 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:13.495851 (+ 269us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:13.495880 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20997,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":6045,"apply.run_cpu_time_us":2246,"apply.run_wall_time_us":32095,"mutex_wait_us":1025,"num_ops":1,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":11670,"prepare.run_wall_time_us":325691,"replication_time_us":644003,"spinlock_wait_cycles":406156544}]]}
I20260807 15:10:13.801891 31314 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:13.802575 31314 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:13.845495 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 351820us
W20260807 15:10:13.848901 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 63893.6us
W20260807 15:10:13.919113 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 70503.2us
I20260807 15:10:13.923362 31314 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:14.002247 31624 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:14.020025 31624 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.024490 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:14.027927 31681 log.cc:924] Time spent T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.225s user 0.001s sys 0.000s
W20260807 15:10:14.029419 31686 log.cc:924] Time spent T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.108s user 0.000s sys 0.000s
I20260807 15:10:14.029867 31624 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:14.047593 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.002858 31692 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:14.016247 31554 raft_consensus.cc:348] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:14.068150 31554 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:14.069067 31554 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:10:14.081274 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 229421us
I20260807 15:10:14.090863 30307 raft_consensus.cc:1203] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20260807 15:10:14.093647 29487 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:14.094946 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 167955us
I20260807 15:10:14.100447 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48690 (request call id 332) took 1733 ms. Trace:
I20260807 15:10:14.103740 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:14.119643 29638 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:14.120462 29638 raft_consensus.cc:595] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:14.100853 29378 rpcz_store.cc:276] 0807 15:10:12.367512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:12.367688 (+ 176us) service_pool.cc:227] Handling call
0807 15:10:12.449205 (+ 81517us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e1d1ed6c 00007f94e1e18c3e 00007f94e012afb4 00007f94e012af42 00007f94e012ae71 00007f94e012adec 00007f94e012a0a2 00007f94da1ee94c 00007f94da1edd86
0807 15:10:14.100384 (+1651179us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:12.486432 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:12.588721 (+102289us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:12.591595 (+ 2874us) write_op.cc:435] Acquired schema lock
0807 15:10:12.595250 (+ 3655us) tablet.cc:660] Decoding operations
0807 15:10:12.646648 (+ 51398us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:12.649535 (+ 2887us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:12.649640 (+ 105us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:10:12.650029 (+ 389us) tablet.cc:699] Row locks acquired
0807 15:10:12.650081 (+ 52us) write_op.cc:260] PREPARE: finished
0807 15:10:12.650365 (+ 284us) write_op.cc:270] Start()
0807 15:10:12.650585 (+ 220us) write_op.cc:276] Timestamp: P: 1786115412650287 usec, L: 0
0807 15:10:12.650640 (+ 55us) op_driver.cc:331] REPLICATION: starting
0807 15:10:12.651865 (+ 1225us) log.cc:842] Serialized 539 byte log entry
0807 15:10:12.815384 (+163519us) op_driver.cc:444] REPLICATION: finished
0807 15:10:13.259275 (+443891us) write_op.cc:301] APPLY: starting
0807 15:10:13.259408 (+ 133us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:13.259661 (+ 253us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:13.316963 (+ 57302us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:13.348788 (+ 31825us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:13.369330 (+ 20542us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:10:13.380963 (+ 11633us) write_op.cc:312] APPLY: finished
0807 15:10:13.384814 (+ 3851us) log.cc:842] Serialized 23 byte log entry
0807 15:10:13.385889 (+ 1075us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:13.385992 (+ 103us) write_op.cc:454] Released schema lock
0807 15:10:13.386042 (+ 50us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:13.386804 (+ 762us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:13.386844 (+ 40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81195,"reported_tablets":2,"spinlock_wait_cycles":45574016,"child_traces":[["op",{"apply.queue_time_us":443482,"apply.run_cpu_time_us":3309,"apply.run_wall_time_us":127918,"mutex_wait_us":108,"num_ops":1,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":5804,"prepare.run_wall_time_us":180224,"replication_time_us":164588,"thread_start_us":122846,"threads_started":1}]]}
I20260807 15:10:14.143792 31554 ts_tablet_manager.cc:1428] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.741s user 0.008s sys 0.003s
W20260807 15:10:14.144234 31554 ts_tablet_manager.cc:1460] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Tablet startup took 743ms
W20260807 15:10:14.144516 31554 ts_tablet_manager.cc:1462] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Trace:
0807 15:10:10.878320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:10.878459 (+ 139us) service_pool.cc:227] Handling call
0807 15:10:10.885445 (+ 6986us) ts_tablet_manager.cc:928] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
0807 15:10:11.246820 (+361375us) tablet_copy_client.cc:361] Tablet copy session begun
0807 15:10:11.363597 (+116777us) tablet_metadata.cc:641] Metadata flushed
0807 15:10:11.363991 (+ 394us) tablet_copy_client.cc:490] Wrote new tablet metadata
0807 15:10:11.643759 (+279768us) tablet_copy_client.cc:411] Wrote new consensus metadata
0807 15:10:11.660249 (+ 16490us) tablet_replica.cc:205] Creating consensus instance
0807 15:10:11.682398 (+ 22149us) ts_tablet_manager.cc:983] Replica registered.
0807 15:10:11.682474 (+ 76us) inbound_call.cc:173] Queueing success response
0807 15:10:11.910379 (+227905us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 15:10:13.402508 (+1492129us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 15:10:13.540170 (+137662us) tablet_replica.cc:259] Starting instrumentation
0807 15:10:13.591392 (+ 51222us) tablet_replica.cc:278] Starting consensus
Metrics: {"dns_us":697,"mutex_wait_us":132267,"raft.queue_time_us":3021,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6605,"tablet-copy.queue_time_us":5709,"tablet-download-pool.queue_time_us":356,"tablet-download-pool.run_cpu_time_us":1223,"tablet-download-pool.run_wall_time_us":96282,"thread_start_us":23615,"threads_started":1}
I20260807 15:10:14.163038 29566 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:14.163782 29566 raft_consensus.cc:595] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:14.154194 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:14.156088 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:14.174079 29379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 174) took 1603 ms. Trace:
I20260807 15:10:14.175439 29485 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:14.176117 29485 raft_consensus.cc:595] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:14.201781 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 15:10:14.204355 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:14.205374 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:14.202711 30273 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:14.174551 29379 rpcz_store.cc:276] 0807 15:10:12.570410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:12.571309 (+ 899us) service_pool.cc:227] Handling call
0807 15:10:14.173997 (+1602688us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:12.719684 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:12.720671 (+ 987us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:12.720727 (+ 56us) write_op.cc:435] Acquired schema lock
0807 15:10:12.720770 (+ 43us) tablet.cc:660] Decoding operations
0807 15:10:12.721754 (+ 984us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:12.721826 (+ 72us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:12.721942 (+ 116us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:10:12.722300 (+ 358us) tablet.cc:699] Row locks acquired
0807 15:10:12.722358 (+ 58us) write_op.cc:260] PREPARE: finished
0807 15:10:12.722603 (+ 245us) write_op.cc:270] Start()
0807 15:10:12.722785 (+ 182us) write_op.cc:276] Timestamp: P: 1786115412722524 usec, L: 0
0807 15:10:12.722833 (+ 48us) op_driver.cc:331] REPLICATION: starting
0807 15:10:12.724056 (+ 1223us) log.cc:842] Serialized 603 byte log entry
0807 15:10:13.250863 (+526807us) op_driver.cc:444] REPLICATION: finished
0807 15:10:13.380694 (+129831us) write_op.cc:301] APPLY: starting
0807 15:10:13.388385 (+ 7691us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:13.402660 (+ 14275us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:13.428485 (+ 25825us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:13.458952 (+ 30467us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:13.466048 (+ 7096us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:10:13.468734 (+ 2686us) write_op.cc:312] APPLY: finished
0807 15:10:13.486964 (+ 18230us) log.cc:842] Serialized 23 byte log entry
0807 15:10:13.498033 (+ 11069us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:13.517653 (+ 19620us) write_op.cc:454] Released schema lock
0807 15:10:13.519674 (+ 2021us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:13.541797 (+ 22123us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:13.542749 (+ 952us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58986,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":118263,"apply.run_cpu_time_us":3000,"apply.run_wall_time_us":182006,"num_ops":1,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":4566,"prepare.run_wall_time_us":4847,"replication_time_us":527855,"thread_start_us":148619,"threads_started":1}]]}
I20260807 15:10:14.269594 29450 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:14.240813 31671 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:14.297230 31699 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:14.260083 31668 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:14.297844 31699 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:14.298833 31668 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.301623 31668 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:14.308523 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 105991us
I20260807 15:10:14.310552 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:14.311345 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 78306.2us
I20260807 15:10:14.402750 29637 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:14.358919 31314 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:14.461880 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 151373us
I20260807 15:10:14.441288 29379 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 5, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:14.466897 31692 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:14.367725 31699 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:14.425570 31598 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:14.476433 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:14.479504 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 84422.8us
I20260807 15:10:14.439246 31314 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.341185 30310 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:14.499475 31314 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:14.486047 31699 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:14.517058 31314 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:14.526307 31314 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:14.532922 31314 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:14.516115 31699 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:14.510499 31692 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:14.541217 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 57323.5us
W20260807 15:10:14.528570 31711 log.cc:924] Time spent T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.067s user 0.001s sys 0.000s
I20260807 15:10:14.542529 31699 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:14.538534 31692 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:14.571540 31692 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:14.562578 31591 raft_consensus.cc:979] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:14.572886 31591 raft_consensus.cc:1067] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:14.550274 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-030a7060e7f744ff9a4e02ea0cd710bd received from {username='slave'} at 127.0.0.1:60682
I20260807 15:10:14.574579 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-030a7060e7f744ff9a4e02ea0cd710bd on tablet 030a7060e7f744ff9a4e02ea0cd710bd with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:14.574568 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:14.578577 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:14.580313 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:14.583119 31692 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:14.584985 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:14.589028 31692 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.591495 31692 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:14.601853 30311 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:14.599547 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.606702 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.607383 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:14.608456 29481 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:14.609301 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:14.610176 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.611219 29637 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:14.614890 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.626766 31314 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:14.629354 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.627527 31669 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:14.631847 31314 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.635640 31314 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:14.616036 31692 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:14.640451 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:14.649101 31692 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.645501 31694 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:14.663122 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:14.664788 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:14.668069 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:14.669297 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:14.674871 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.678224 29533 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:14.688805 29533 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:14.674305 31406 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260807 15:10:14.700104 29569 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:14.700785 29569 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:14.701257 29569 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:14.700816 31314 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:14.688889 31642 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:14.664299 31694 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.709143 31669 raft_consensus.cc:979] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:14.709728 31546 raft_consensus.cc:1067] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:14.714010 31670 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:14.714659 31670 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:14.716809 31670 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:14.719072 29531 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:14.720805 31692 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:14.721232 31509 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:14.707661 31694 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:14.729687 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.730566 29487 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:10:14.733961 29643 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:10:14.734555 29643 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:14.734908 29643 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:14.752950 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 64208.1us
I20260807 15:10:14.753594 31314 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:14.779954 31406 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:14.781512 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:14.782703 31509 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:14.788699 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:14.789705 31497 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:14.790444 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:14.791730 31406 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:14.793085 29609 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:14.764300 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:14.800179 29450 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:14.802093 29643 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.803158 29450 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:14.807509 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:14.895583 29378 catalog_manager.cc:5495] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:14.893625 29643 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:14.884778 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:14.903484 29568 raft_consensus.cc:3032] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:14.903882 30307 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:14.903939 29568 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:14.804133 31699 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:10:14.876021 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 72944.3us
I20260807 15:10:14.816088 31666 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:14.908401 29568 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:14.909554 29568 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:14.884860 29569 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:14.849161 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:14.922258 29569 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:14.929991 31690 raft_consensus.cc:979] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:14.932469 31701 raft_consensus.cc:1067] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:14.809403 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.952497 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:14.953682 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:14.966557 31670 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:14.969606 31670 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:14.970551 31670 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:14.983107 29568 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:14.988596 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:14.997601 29637 raft_consensus.cc:3032] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:14.998186 29637 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:14.989717 30307 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:14.990617 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:15.000567 29483 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:14.999689 29637 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:15.004480 29609 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:15.007045 29637 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:15.012522 29570 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:10:15.013562 29570 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:15.014029 29570 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:15.023303 30312 raft_consensus.cc:1226] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:15.027340 31682 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:15.028033 31682 raft_consensus.cc:686] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:15.029155 31682 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:15.034782 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 57966.9us
I20260807 15:10:15.046787 29483 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:15.047525 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:15.043831 29570 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:15.065783 31695 raft_consensus.cc:1050] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:15.074615 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:15.075405 31314 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:15.090631 29533 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:15.092772 29570 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:15.095374 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:15.096204 29480 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:15.096552 29480 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:10:15.097584 29367 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress
I20260807 15:10:15.097528 29480 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:15.099439 29480 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:15.093303 31723 log.cc:924] Time spent T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.132s user 0.000s sys 0.002s
I20260807 15:10:15.076371 31497 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:15.110683 29569 consensus_queue.cc:237] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:15.125268 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:15.126377 29643 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:15.126997 29637 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:15.116731 29480 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:15.096776 31629 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:15.153837 31314 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:15.161708 29367 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 73075us
I20260807 15:10:15.173350 31695 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:15.156905 31629 raft_consensus.cc:686] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:15.177343 31629 consensus_queue.cc:237] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:15.201656 29643 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:15.216931 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:15.217842 30312 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:15.226660 30307 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:10:15.237382 29480 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.241483 29531 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:15.200021 31670 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:15.256312 29637 raft_consensus.cc:1226] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:15.252836 31643 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:15.291113 30312 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:15.260812 31509 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260807 15:10:15.286813 31643 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
W20260807 15:10:15.314113 29367 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c235e827abcd4d26adef777f50f15d3e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9bbe5c211ab64989a57350f34f007ced is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:15.336563 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 89276.7us
I20260807 15:10:15.339426 30312 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260807 15:10:15.343505 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 106043us
I20260807 15:10:15.344136 29644 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:10:15.346845 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:15.324347 31643 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:15.366837 31629 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:15.372171 31670 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:15.342917 31694 consensus_queue.cc:1046] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260807 15:10:15.373796 31694 raft_consensus.cc:3032] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:15.374161 31694 raft_consensus.cc:729] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:15.374969 31694 consensus_queue.cc:260] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:15.383000 31546 consensus_queue.cc:1159] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9bbe5c211ab64989a57350f34f007ced" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260807 15:10:15.390756 29382 catalog_manager.cc:5495] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.396879 29637 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:15.408205 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:15.382951 31694 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:15.418081 29637 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.414348 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:15.444393 29480 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:15.408816 31546 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260807 15:10:15.464653 31684 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:15.416508 31629 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.469594 30306 raft_consensus.cc:2932] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:15.473559 31735 log.cc:924] Time spent T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260807 15:10:15.485841 29378 catalog_manager.cc:5495] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:15.459512 29609 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:15.493950 29561 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:15.498319 31732 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:10:15.518823 31684 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:15.569522 30310 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:15.571269 31682 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:15.605440 29380 catalog_manager.cc:5495] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.632828 29569 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:15.630468 31692 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.643209 29483 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.650959 29485 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:15.652375 30312 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.657634 31682 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:15.672451 31689 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:15.672843 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5fd4d41c286445e997322bdb49e97c65 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:15.766918 29637 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 15:10:15.840713 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 47464.8us
W20260807 15:10:15.840971 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 48860.4us
W20260807 15:10:15.840735 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 61599.7us
I20260807 15:10:15.843853 31509 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 15:10:15.840396 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 59762.1us
I20260807 15:10:15.854514 29379 catalog_manager.cc:5495] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:15.871280 29379 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:15.886551 29637 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.896575 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fd4d41c286445e997322bdb49e97c65 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:10:15.909911 31751 tablet_replica.cc:330] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:10:15.911629 29638 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:15.912617 31751 raft_consensus.cc:2229] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:15.918198 31684 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:15.940040 29378 catalog_manager.cc:5495] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 4 to 5, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:15.941346 29485 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:15.956697 31751 raft_consensus.cc:2258] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:15.977108 31694 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:15.978310 31751 ts_tablet_manager.cc:1905] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:15.993978 30307 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:15.995782 31694 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260807 15:10:16.022440 31751 ts_tablet_manager.cc:1918] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:10:16.023061 31751 log.cc:1196] T 5fd4d41c286445e997322bdb49e97c65 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/5fd4d41c286445e997322bdb49e97c65
I20260807 15:10:16.024961 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet 5fd4d41c286445e997322bdb49e97c65 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:16.033874 29569 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:16.064692 29568 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52540
I20260807 15:10:16.065376 29568 raft_consensus.cc:595] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Received request to transfer leadership
I20260807 15:10:16.075630 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:16.077502 30312 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:16.082916 29480 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:16.091091 31694 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:16.092818 31546 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:16.098559 31406 raft_consensus.cc:979] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:16.099504 31406 raft_consensus.cc:1067] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:16.115432 30312 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:16.111174 31684 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:16.139220 29480 raft_consensus.cc:2932] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:16.151687 29378 catalog_manager.cc:5495] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 5 to 6, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:16.160526 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 030a7060e7f744ff9a4e02ea0cd710bd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:16.176590 29566 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52540
I20260807 15:10:16.177170 29566 raft_consensus.cc:595] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Received request to transfer leadership
I20260807 15:10:16.180158 29638 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:10:16.183939 29638 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:16.184335 29638 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:16.201169 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet 030a7060e7f744ff9a4e02ea0cd710bd with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46792
I20260807 15:10:16.204639 29638 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:16.219596 31757 tablet_replica.cc:330] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:10:16.225333 29638 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:16.226087 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:16.245796 29569 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:16.246212 29569 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:16.230664 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:16.247174 29569 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:16.248322 30312 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:16.249176 29569 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:16.254864 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:16.255820 29480 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:16.244983 29366 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 66689.2us
I20260807 15:10:16.258351 29566 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52540
I20260807 15:10:16.259464 30312 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:16.261523 29569 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:16.269960 29566 raft_consensus.cc:595] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Received request to transfer leadership
I20260807 15:10:16.270382 29566 raft_consensus.cc:603] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:10:16.272086 31757 raft_consensus.cc:2229] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:16.279608 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:16.283682 31549 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:16.284432 31549 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:16.285594 31549 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:16.328537 29432 auto_rebalancer.cc:663] Could not move replica: Illegal state: not currently leader
W20260807 15:10:16.329090 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Illegal state: not currently leader
I20260807 15:10:16.331233 29480 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:16.332356 31757 raft_consensus.cc:2258] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:16.355502 31757 ts_tablet_manager.cc:1905] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:16.360697 29378 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 5, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:16.391212 29569 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:16.391853 29569 raft_consensus.cc:595] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:10:16.394991 29644 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:16.395632 29644 raft_consensus.cc:595] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:16.406080 31757 ts_tablet_manager.cc:1918] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260807 15:10:16.406702 31757 log.cc:1196] T 030a7060e7f744ff9a4e02ea0cd710bd P 4b092f7f951b4137b5d7810056684270: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-2-root/wals/030a7060e7f744ff9a4e02ea0cd710bd
I20260807 15:10:16.407678 29644 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:16.408448 29644 raft_consensus.cc:595] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:16.409379 29365 catalog_manager.cc:4841] TS 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): tablet 030a7060e7f744ff9a4e02ea0cd710bd (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:16.411837 29566 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:16.412532 29566 raft_consensus.cc:595] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:16.413774 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 15:10:16.415591 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:16.416253 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:10:16.578169 29365 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c235e827abcd4d26adef777f50f15d3e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260807 15:10:16.669220 31694 raft_consensus.cc:979] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:16.671639 31684 raft_consensus.cc:1067] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:16.685346 29483 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:16.686053 29483 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:16.686501 29483 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:16.691676 31509 raft_consensus.cc:979] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:10:16.692364 31509 raft_consensus.cc:1067] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:10:16.700261 30307 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48584
I20260807 15:10:16.700997 30307 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:16.701385 30307 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:16.719283 29483 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:16.720337 29561 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:16.728639 30307 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:16.734802 31640 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:16.735203 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:16.735843 29485 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:16.738411 31604 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:16.739090 31604 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:16.742100 31604 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:16.743257 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:16.744212 30310 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:10:16.745018 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:16.745260 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:16.745914 29644 raft_consensus.cc:2379] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:16.746145 29561 raft_consensus.cc:2379] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:16.738458 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:16.747098 29638 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:16.748606 29483 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:16.738458 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:16.752981 29569 raft_consensus.cc:3032] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:16.753331 29569 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:16.754098 29450 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:16.757516 31699 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:16.754109 29569 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:16.767488 29569 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:16.784868 31549 raft_consensus.cc:979] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:16.785555 31549 raft_consensus.cc:1067] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:16.786851 30307 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:16.791862 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:16.792712 29561 raft_consensus.cc:3032] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:16.793202 29561 raft_consensus.cc:729] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:16.794242 29561 consensus_queue.cc:260] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:16.795781 29561 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:16.801775 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:16.802500 29566 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:16.802970 29566 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:16.806867 29485 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:16.810086 29638 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:16.810475 30274 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:16.811640 31697 raft_consensus.cc:2781] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:16.812204 31697 raft_consensus.cc:686] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:16.813156 31697 consensus_queue.cc:237] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:16.814555 31699 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:16.834177 29378 catalog_manager.cc:5495] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 3 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:16.852192 29569 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:16.859344 29561 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:16.864527 29566 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:16.868397 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:16.869063 29638 raft_consensus.cc:3032] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:16.869366 29638 raft_consensus.cc:729] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:16.870148 29638 consensus_queue.cc:260] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:16.871310 29638 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:16.876718 29566 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:16.881157 29638 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:16.882310 29531 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:16.883149 31759 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:16.883618 31759 raft_consensus.cc:686] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:16.884471 31759 consensus_queue.cc:237] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:16.903002 29483 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:16.904721 31731 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:16.916968 29378 catalog_manager.cc:5495] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 4 to 5, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 5 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
W20260807 15:10:16.926728 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 165368us
I20260807 15:10:16.930581 29449 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:16.931761 31604 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:16.868631 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:16.935562 29485 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:16.938964 31604 raft_consensus.cc:686] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:16.940481 31604 consensus_queue.cc:237] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:16.980636 30307 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:16.986387 31549 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:16.989248 31731 raft_consensus.cc:979] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:16.989794 31770 raft_consensus.cc:1067] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:16.993359 29378 catalog_manager.cc:5495] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:17.019430 29480 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:17.020068 29480 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:17.020458 29480 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:16.982595 29485 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:17.027721 29480 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:17.029654 29480 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:17.030730 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:17.031600 30307 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:17.044296 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:17.045044 29644 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:17.045367 29644 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:17.050733 29644 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:17.052126 29644 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:17.057296 30307 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:17.059557 29452 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:17.062170 31761 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:17.062731 31761 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:17.063529 31761 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:17.103758 31549 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:17.104351 31549 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:17.107312 31549 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:17.108528 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:17.108863 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:17.109254 29480 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:17.109609 30312 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:10:17.111001 29609 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:17.112812 31769 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:17.113212 31769 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:17.113534 31769 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:17.115679 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:17.116508 29569 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:17.121407 31769 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:17.120592 29644 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:17.134130 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:17.134788 29485 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:17.138120 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:17.138584 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:17.138723 31769 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:17.139264 30312 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 3
I20260807 15:10:17.138796 29569 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:17.154204 29485 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:17.164250 29569 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:17.174804 29608 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:17.175676 31769 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:17.176203 31769 raft_consensus.cc:686] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:17.177045 31769 consensus_queue.cc:237] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:17.163635 29380 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 5 to 6, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 6 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:17.195087 30312 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:17.238557 29380 catalog_manager.cc:5495] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 2, term changed from 1 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195), fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193), VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194), VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195), VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:17.245774 29570 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:17.247483 31671 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:17.298162 29480 raft_consensus.cc:1261] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 15:10:17.299823 29485 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:17.302361 31759 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:17.302930 31671 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:17.365777 29638 raft_consensus.cc:1261] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 15:10:17.368739 31759 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:17.440980 29569 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:17.442776 31762 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:17.471796 29637 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:17.482110 31699 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:17.496008 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:17.573751 29644 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260807 15:10:17.576869 31761 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 15:10:17.593971 30307 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260807 15:10:17.595829 31699 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 15:10:17.619002 29638 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:17.632508 30310 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:17.635794 29485 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:17.684386 29569 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:17.686689 31770 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:10:17.689100 31640 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 15:10:17.702179 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 58381.6us
W20260807 15:10:17.711036 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 58990.1us
I20260807 15:10:17.714619 31640 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:10:17.745167 31640 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 5 to 8, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:17.759200 29480 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:17.760802 30307 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 5 to 8, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:17.808250 29378 catalog_manager.cc:5495] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193), VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194), VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195), VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:17.825043 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 159843us
I20260807 15:10:17.826716 31769 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:17.834415 30312 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:17.838353 29480 raft_consensus.cc:2932] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 5 to 8, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:17.848501 31769 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:17.856526 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c235e827abcd4d26adef777f50f15d3e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260807 15:10:17.908839 29380 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 5 to 8, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:17.922137 31640 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:17.938167 30312 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:17.989542 31793 log.cc:924] Time spent T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.058s user 0.003s sys 0.000s
W20260807 15:10:18.037595 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 50420.5us
W20260807 15:10:18.153035 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 57976.3us
W20260807 15:10:18.181293 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 82259.9us
W20260807 15:10:18.164157 31794 log.cc:924] Time spent T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
W20260807 15:10:18.284428 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 101841us
I20260807 15:10:18.301676 29644 consensus_queue.cc:237] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:18.345369 29638 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:18.346104 29638 raft_consensus.cc:595] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:18.412593 30310 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260807 15:10:18.419144 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 55593.2us
I20260807 15:10:18.425199 31823 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:18.435004 31825 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:18.437925 30310 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:18.445088 29569 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:18.451202 29638 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:18.451933 29638 raft_consensus.cc:595] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
W20260807 15:10:18.418042 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 128064us
I20260807 15:10:18.462225 29481 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:18.462860 29481 raft_consensus.cc:595] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:18.467177 31814 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:18.467832 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 8f248aa577ff4c798c99df5834ea66e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:18.475013 31816 raft_consensus.cc:979] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:18.474417 29380 catalog_manager.cc:5495] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:18.475740 31823 raft_consensus.cc:1067] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:18.476388 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 15:10:18.478258 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:18.482043 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:18.484128 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:18.484732 29566 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:18.485098 29566 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:18.483687 29570 raft_consensus.cc:2932] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:18.531541 29566 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:18.539722 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet c235e827abcd4d26adef777f50f15d3e with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:52540
I20260807 15:10:18.541976 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:18.542711 29644 raft_consensus.cc:3032] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:18.543067 29644 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:18.548005 31827 tablet_replica.cc:330] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:10:18.547818 29644 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:18.549106 29644 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:18.549714 31827 raft_consensus.cc:2229] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:18.550418 31827 raft_consensus.cc:2258] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:18.558125 31827 ts_tablet_manager.cc:1905] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:18.562105 29566 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:18.568274 31823 raft_consensus.cc:979] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:18.568809 31825 raft_consensus.cc:1067] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:18.570410 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:18.570977 29566 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:18.571331 29566 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:18.592742 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f248aa577ff4c798c99df5834ea66e5 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33668
I20260807 15:10:18.598598 31827 ts_tablet_manager.cc:1918] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260807 15:10:18.600243 31827 log.cc:1196] T c235e827abcd4d26adef777f50f15d3e P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/c235e827abcd4d26adef777f50f15d3e
I20260807 15:10:18.608220 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:18.608882 30310 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:18.619086 30310 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:18.621773 29644 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:18.620573 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet c235e827abcd4d26adef777f50f15d3e (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:18.629738 29566 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:18.631320 29531 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:18.633313 31828 tablet_replica.cc:330] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:10:18.638566 31759 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:18.639117 31759 raft_consensus.cc:686] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:18.640133 31759 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:18.645413 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:18.646080 29483 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:18.647189 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:18.648087 29644 raft_consensus.cc:3032] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:18.648422 29644 raft_consensus.cc:729] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:18.651409 29644 consensus_queue.cc:260] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:18.652976 29644 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:18.656498 29566 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:18.663471 29483 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:18.664821 29533 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:18.665752 31804 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:18.666282 31804 raft_consensus.cc:686] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:18.667156 31804 consensus_queue.cc:237] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:18.673892 29644 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:18.665302 31828 raft_consensus.cc:2229] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:18.683379 31828 raft_consensus.cc:2258] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:18.705593 31828 ts_tablet_manager.cc:1905] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:18.737097 31798 raft_consensus.cc:979] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:18.737716 31798 raft_consensus.cc:1067] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:18.748175 29644 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:18.748828 29644 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:18.749195 29644 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:18.751062 29380 catalog_manager.cc:5495] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:18.776031 29379 catalog_manager.cc:5495] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:18.786727 29644 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:18.912819 29644 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:18.933132 31828 ts_tablet_manager.cc:1918] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260807 15:10:18.933920 31828 log.cc:1196] T 8f248aa577ff4c798c99df5834ea66e5 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/8f248aa577ff4c798c99df5834ea66e5
I20260807 15:10:18.942332 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet 8f248aa577ff4c798c99df5834ea66e5 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:18.944965 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:18.946033 29483 raft_consensus.cc:3032] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:18.946520 29483 raft_consensus.cc:729] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:18.947499 29483 consensus_queue.cc:260] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:18.959720 29483 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:10:19.029492 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 70360.1us
I20260807 15:10:19.078316 29483 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:19.142966 29609 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:19.156020 31839 raft_consensus.cc:2781] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:19.157872 31839 raft_consensus.cc:686] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:19.163543 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:19.165123 29566 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:19.167475 31839 consensus_queue.cc:237] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:19.184039 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 185014us
W20260807 15:10:19.198925 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 242101us
I20260807 15:10:19.231048 29644 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:19.235327 29380 catalog_manager.cc:5495] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:19.237422 31804 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:19.257136 29638 raft_consensus.cc:1261] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:19.259619 30310 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:19.259351 31759 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:19.345171 29566 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:19.384743 29487 raft_consensus.cc:1261] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:19.461230 31789 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260807 15:10:19.452310 31779 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 15:10:19.597898 29570 raft_consensus.cc:1261] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:19.602721 31852 consensus_queue.cc:1035] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:19.726821 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:19.819972 29480 raft_consensus.cc:1261] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:19.826658 31852 consensus_queue.cc:1035] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:20.037583 29481 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:20.038367 29481 raft_consensus.cc:595] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:20.043181 29644 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:20.043830 29644 raft_consensus.cc:595] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS fbf78964d70448269802ac7de9d7a198
I20260807 15:10:20.047686 29570 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e0c073edf1454d1589526a840754b5da"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:20.048278 29570 raft_consensus.cc:595] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:20.050128 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 15:10:20.052085 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:20.052802 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:10:20.137682 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 55865.6us
I20260807 15:10:20.196754 29643 consensus_queue.cc:237] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:10:20.244578 29609 consensus_peers.cc:487] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d87368aeb34548079f36255279bee400. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:20.245779 29566 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:20.248309 29481 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:20.248466 31814 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 15:10:20.252086 31852 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:20.291524 31798 raft_consensus.cc:979] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:20.292096 31798 raft_consensus.cc:1067] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:20.293826 29566 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:10:20.294449 29566 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:20.294833 29566 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:20.307875 31814 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:20.313125 29566 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:20.321530 29487 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:20.353152 29379 catalog_manager.cc:5495] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:20.360577 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:20.361351 29487 raft_consensus.cc:3032] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:20.361783 29487 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:20.362684 29487 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:20.364045 29487 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:20.367776 29566 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:20.372243 31839 raft_consensus.cc:979] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270: : Instructing follower fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:10:20.373559 31816 raft_consensus.cc:1067] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer fbf78964d70448269802ac7de9d7a198 to start an election
I20260807 15:10:20.374063 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:20.374666 30307 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:20.379989 29566 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:20.384099 30312 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
from {username='slave'} at 127.0.0.1:48588
I20260807 15:10:20.384809 30312 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:20.385211 30312 raft_consensus.cc:3037] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:20.390820 29487 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:20.392959 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:20.393872 31759 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
W20260807 15:10:20.394541 29432 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: leader transfer in progress
I20260807 15:10:20.398841 30307 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:20.417630 30312 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:20.469666 31759 raft_consensus.cc:686] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:20.484582 31759 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:20.493732 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet e0c073edf1454d1589526a840754b5da, TS 9bbe5c211ab64989a57350f34f007ced -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:20.494117 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet e0c073edf1454d1589526a840754b5da, TS 9bbe5c211ab64989a57350f34f007ced -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:20.500241 30312 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:20.501678 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:20.502481 29643 raft_consensus.cc:3032] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:20.502857 29643 raft_consensus.cc:729] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:20.503854 29643 consensus_queue.cc:260] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:20.505440 29643 raft_consensus.cc:3037] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:20.509886 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:20.510547 29487 raft_consensus.cc:3037] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:10:20.524153 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 37e098505a6248f0aa9d91084fbbe64e, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:20.524520 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 37e098505a6248f0aa9d91084fbbe64e, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:20.526670 29487 raft_consensus.cc:2454] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:20.528066 30274 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:20.529158 31776 raft_consensus.cc:2781] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:20.529764 31776 raft_consensus.cc:686] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:20.530562 31776 consensus_queue.cc:237] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:20.549362 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 2dfe227bf905440483bae2c8a294fb1b, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:20.549718 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 2dfe227bf905440483bae2c8a294fb1b, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:20.572021 31867 raft_consensus.cc:979] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:20.572551 31779 raft_consensus.cc:1067] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:20.574570 29481 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e0c073edf1454d1589526a840754b5da"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44122
I20260807 15:10:20.575120 29481 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:20.575485 29481 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:20.576435 29382 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:20.587321 29481 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:20.601635 29643 raft_consensus.cc:2454] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:20.614765 29481 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:20.615172 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:20.615751 29566 raft_consensus.cc:3032] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:20.616075 29566 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:20.616822 29566 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:20.625109 29566 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:20.622704 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:20.626310 29644 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:20.639128 29566 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:20.653049 29644 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:20.654364 29449 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:20.655463 31836 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:20.656011 31836 raft_consensus.cc:686] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:20.657015 31836 consensus_queue.cc:237] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:20.662515 29378 catalog_manager.cc:5495] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:20.693245 29380 catalog_manager.cc:5495] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 4 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
W20260807 15:10:20.767396 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 58888.8us
I20260807 15:10:20.768947 31874 ts_tablet_manager.cc:927] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:20.824811 31874 tablet_copy_client.cc:316] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:10:20.833870 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet d87368aeb34548079f36255279bee400 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:10:20.834519 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet d87368aeb34548079f36255279bee400 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-d87368aeb34548079f36255279bee400
I20260807 15:10:20.858316 29658 tablet_copy_source_session.cc:205] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:20.866220 31874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d87368aeb34548079f36255279bee400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:20.927987 31874 tablet_copy_client.cc:791] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:20.928736 31874 tablet_copy_client.cc:655] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:20.940603 31874 tablet_copy_client.cc:531] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:20.952956 29487 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:20.955662 31874 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:20.964208 31759 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:20.986821 30307 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:21.007241 31789 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260807 15:10:21.050043 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 44096us
I20260807 15:10:21.069304 29487 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:21.071807 31837 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:21.216540 29638 raft_consensus.cc:1261] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:21.222640 31837 consensus_queue.cc:1035] T 7645f7cacdb34a1486686ba6f848e1bb P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:21.232489 29638 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:21.241333 31761 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:21.290776 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:10:21.304943 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 48340.2us
W20260807 15:10:21.356073 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 105058us
W20260807 15:10:21.385020 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 98255.8us
W20260807 15:10:21.430107 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 124104us
W20260807 15:10:21.513439 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 114896us
I20260807 15:10:21.524730 29564 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 15:10:21.525934 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 141923us
I20260807 15:10:21.593686 29479 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:21.626698 29479 raft_consensus.cc:595] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
W20260807 15:10:21.696125 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 148280us
W20260807 15:10:21.682796 31874 log.cc:924] Time spent T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
W20260807 15:10:21.701623 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 182320us
I20260807 15:10:21.764881 31874 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:21.767406 31874 tablet_bootstrap.cc:492] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
W20260807 15:10:21.797616 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 85516.3us
I20260807 15:10:21.827656 31874 ts_tablet_manager.cc:1397] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.872s user 0.027s sys 0.025s
I20260807 15:10:21.841153 31798 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260807 15:10:21.868927 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 156941us
W20260807 15:10:21.837072 31894 log.cc:924] Time spent T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.478s user 0.002s sys 0.003s
I20260807 15:10:21.957247 31874 raft_consensus.cc:348] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:21.958626 31874 raft_consensus.cc:729] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:21.972994 29570 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:58646
I20260807 15:10:21.973860 29570 raft_consensus.cc:595] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:21.980276 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 15:10:21.982103 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:21.982785 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:21.984118 31874 consensus_queue.cc:260] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:10:21.975569 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 437927us
I20260807 15:10:21.988901 31874 ts_tablet_manager.cc:1428] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.161s user 0.008s sys 0.000s
I20260807 15:10:22.059134 30312 raft_consensus.cc:1203] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:10:22.067997 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-d87368aeb34548079f36255279bee400 received from {username='slave'} at 127.0.0.1:35570
I20260807 15:10:22.068558 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-d87368aeb34548079f36255279bee400 on tablet d87368aeb34548079f36255279bee400 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:22.085754 31923 raft_consensus.cc:979] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
W20260807 15:10:22.089915 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 58195.9us
I20260807 15:10:22.086329 31923 raft_consensus.cc:1067] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:22.122565 29637 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:22.123414 29637 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:22.123881 29637 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:22.196714 29637 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:22.200278 29637 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:22.201120 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:22.201740 30307 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:22.200270 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:22.216316 29480 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:22.216830 29480 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:22.219604 29480 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:22.221424 29480 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:22.253820 30307 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:22.265206 31887 raft_consensus.cc:979] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:22.265795 31887 raft_consensus.cc:1067] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:22.269073 29637 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59992
I20260807 15:10:22.269685 29637 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:22.270058 29637 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:22.272820 29480 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:22.276413 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:22.278002 31910 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:22.279405 31910 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:22.282984 29637 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:22.280596 31910 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:22.292583 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:22.293296 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:22.293359 29570 raft_consensus.cc:3032] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:22.292837 29637 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:22.294050 29570 raft_consensus.cc:729] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:22.294243 29485 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:22.294991 29570 consensus_queue.cc:260] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:22.299115 29570 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:22.302887 29485 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:22.305130 29609 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:22.315609 31892 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:22.316349 31892 raft_consensus.cc:686] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:22.317258 31892 consensus_queue.cc:237] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:22.351856 29378 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:22.358362 29570 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:22.472067 31910 raft_consensus.cc:1050] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:22.479857 31910 consensus_queue.cc:237] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:22.513635 30307 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:22.516274 31921 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:22.522679 29570 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:22.524819 31921 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:22.532106 29479 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:22.533949 31921 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:22.550819 29378 catalog_manager.cc:5495] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:22.574215 31823 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:22.582592 29570 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:22.601495 29479 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:22.594726 30307 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:23.480392 31952 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:23.481374 31952 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.491675 31952 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:23.545702 29382 catalog_manager.cc:5495] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } attrs { replace: true } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:23.273296 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:23.566473 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 347) took 1049 ms. Trace:
I20260807 15:10:23.566861 29378 rpcz_store.cc:276] 0807 15:10:22.517288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:22.517452 (+ 164us) service_pool.cc:227] Handling call
0807 15:10:22.546465 (+ 29013us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e1d1ed6c 00007f94e1e18c3e 00007f94e012afb4 00007f94e012af42 00007f94e012ae71 00007f94e012adec 00007f94e012a0a2 00007f94da1ee94c 00007f94da1edd86
0807 15:10:23.566361 (+1019896us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:22.566483 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:22.567018 (+ 535us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:22.567051 (+ 33us) write_op.cc:435] Acquired schema lock
0807 15:10:22.567070 (+ 19us) tablet.cc:660] Decoding operations
0807 15:10:22.567412 (+ 342us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:22.567469 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:22.567499 (+ 30us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:10:22.567706 (+ 207us) tablet.cc:699] Row locks acquired
0807 15:10:22.567726 (+ 20us) write_op.cc:260] PREPARE: finished
0807 15:10:22.567868 (+ 142us) write_op.cc:270] Start()
0807 15:10:22.568025 (+ 157us) write_op.cc:276] Timestamp: P: 1786115422567820 usec, L: 0
0807 15:10:22.568054 (+ 29us) op_driver.cc:331] REPLICATION: starting
0807 15:10:22.568820 (+ 766us) log.cc:842] Serialized 544 byte log entry
0807 15:10:22.590302 (+ 21482us) op_driver.cc:444] REPLICATION: finished
0807 15:10:22.590804 (+ 502us) write_op.cc:301] APPLY: starting
0807 15:10:22.590888 (+ 84us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:22.590985 (+ 97us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:22.591098 (+ 113us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:22.591345 (+ 247us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:22.591495 (+ 150us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:10:22.591544 (+ 49us) write_op.cc:312] APPLY: finished
0807 15:10:22.591745 (+ 201us) log.cc:842] Serialized 23 byte log entry
0807 15:10:22.609154 (+ 17409us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:22.609238 (+ 84us) write_op.cc:454] Released schema lock
0807 15:10:22.609268 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:22.609455 (+ 187us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:22.609473 (+ 18us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":62485248,"child_traces":[["op",{"apply.queue_time_us":179,"apply.run_cpu_time_us":1731,"apply.run_wall_time_us":18976,"num_ops":1,"prepare.queue_time_us":444,"prepare.run_cpu_time_us":2613,"prepare.run_wall_time_us":2612,"replication_time_us":22061}]]}
I20260807 15:10:23.605069 31957 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:23.607805 31956 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:23.608713 31956 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.632268 31952 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:23.633212 31952 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:23.606698 31957 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.637252 31952 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:23.647102 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:23.656519 31957 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:23.658732 31912 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:23.659363 31912 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.661861 31912 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:23.665880 31912 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:23.666589 31955 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:23.667367 31955 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:23.670607 31955 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:23.666450 31912 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.673064 31955 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:23.673964 31912 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:23.673808 31955 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.676797 31955 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:23.677697 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 1.0012e+06us
I20260807 15:10:23.681838 31956 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:23.683243 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:23.685645 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:23.689134 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:23.689251 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:23.692749 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:23.693409 31912 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:23.694578 31887 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:23.693914 31912 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.695066 31887 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:23.696779 31912 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:23.697134 31887 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:23.708129 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:23.712757 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:23.714277 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:23.716897 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:23.718653 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:23.735183 30306 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:23.743847 29483 raft_consensus.cc:1261] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:23.745563 31887 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:23.746160 31887 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.748168 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:23.748427 31952 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:23.748749 31887 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:23.749037 31952 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:23.751264 31952 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:23.756464 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08003477c0 after lost signal to thread 28230
W20260807 15:10:23.757627 29511 debug-util.cc:398] Leaking SignalData structure 0x7b0800342720 after lost signal to thread 29417
W20260807 15:10:23.758932 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad880 after lost signal to thread 29514
I20260807 15:10:23.758735 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:23.760115 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08001224a0 after lost signal to thread 29594
I20260807 15:10:23.760779 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:23.761236 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08002fef20 after lost signal to thread 29674
W20260807 15:10:23.762419 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6fe0 after lost signal to thread 30341
W20260807 15:10:23.763006 29511 debug-util.cc:398] Leaking SignalData structure 0x7b0800305620 after lost signal to thread 31914
I20260807 15:10:23.763273 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:23.764366 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:23.766402 31892 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:23.766932 31892 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:23.768903 31892 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:23.784808 30272 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:23.786393 31961 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:23.788395 30272 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:23.792079 31961 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:23.811328 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:23.811270 31965 consensus_queue.cc:1035] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:23.814251 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:23.816596 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:23.816536 31967 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:23.818418 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:23.820293 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:23.822621 29485 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:23.826642 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:23.829668 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:23.833433 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:23.846338 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:23.846469 29450 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:23.848292 31950 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:23.856355 29569 raft_consensus.cc:1261] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:23.859582 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:23.860925 31952 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:23.861567 29644 consensus_queue.cc:237] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:23.861163 29450 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:23.863451 31952 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:23.865855 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:23.866025 31965 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:23.866858 31912 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:23.868362 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:23.869982 31912 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:23.878207 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:23.901984 29531 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:23.903338 31909 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:23.905071 29531 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:23.906263 31909 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:23.910162 29531 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:23.911528 31909 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:23.911763 30310 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:10:23.913970 29485 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:10:23.915961 29531 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:23.919214 29644 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:23.919981 29644 raft_consensus.cc:595] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:23.919046 31909 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:23.921505 29531 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:23.921581 31892 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:23.923005 31909 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:23.936707 31909 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:23.940317 31967 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:23.947382 31909 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:23.966347 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:23.966797 31909 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:23.971530 31967 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:23.988162 30310 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:24.013334 29380 catalog_manager.cc:5495] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New cstate: current_term: 1 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 15:10:24.020526 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 77648.1us
I20260807 15:10:24.021428 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet d87368aeb34548079f36255279bee400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:24.022797 29485 raft_consensus.cc:2932] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:24.025799 31966 consensus_queue.cc:1035] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:24.028849 29608 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:24.029626 31966 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:24.035959 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:24.040719 29531 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:24.052325 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet d87368aeb34548079f36255279bee400 with delete_type TABLET_DATA_TOMBSTONED (TS 00dd11bf8fd9487580aba733c2996a4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52540
I20260807 15:10:24.065871 29643 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:24.066725 29643 raft_consensus.cc:595] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:24.071672 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 15:10:24.073663 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:24.074353 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:24.096032 31887 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:24.169734 31982 tablet_replica.cc:330] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: stopping tablet replica
I20260807 15:10:24.179116 31982 raft_consensus.cc:2229] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:24.179836 31982 raft_consensus.cc:2258] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:24.184851 31966 raft_consensus.cc:979] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:24.185345 31966 raft_consensus.cc:1067] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:24.186789 31961 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:24.187350 31961 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:24.189133 29485 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:24.189697 29485 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:24.190035 29485 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:24.190614 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:24.192265 31961 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:24.199656 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:24.201177 30273 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:24.202260 31961 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:24.200660 31982 ts_tablet_manager.cc:1905] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:24.211387 29485 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:24.213937 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:24.214543 29568 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:24.217922 29485 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:24.218535 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:24.219163 29644 raft_consensus.cc:3032] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:24.219466 29644 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:24.220283 29644 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:24.221745 29644 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:24.225287 29568 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:24.226408 29450 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:24.227435 31950 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:24.228796 31950 raft_consensus.cc:686] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:24.230013 31950 consensus_queue.cc:237] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:24.231119 29644 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:24.249641 29380 catalog_manager.cc:5495] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 4 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:24.257959 31982 ts_tablet_manager.cc:1918] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:10:24.258582 31982 log.cc:1196] T d87368aeb34548079f36255279bee400 P 00dd11bf8fd9487580aba733c2996a4a: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-1-root/wals/d87368aeb34548079f36255279bee400
I20260807 15:10:24.261104 29366 catalog_manager.cc:4841] TS 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): tablet d87368aeb34548079f36255279bee400 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:24.347909 31916 raft_consensus.cc:979] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:24.348539 31892 raft_consensus.cc:1067] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:24.350343 29485 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:24.351061 29485 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:24.351495 29485 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:24.364444 29485 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:24.367735 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:24.368434 29644 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:24.368752 29644 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:24.369534 29644 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:24.370769 29644 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:24.380265 29485 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:24.383813 29644 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:24.385530 29449 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:24.379592 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:24.386904 30310 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:24.389302 31953 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:24.389889 31953 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:24.390755 31953 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:24.405218 30310 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:24.419143 29380 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 4 to 5, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 5 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:24.720578 29568 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:24.721926 31952 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:24.748252 29643 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:24.750638 31952 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:24.847394 29643 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:24.849210 31950 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:10:24.858057 30310 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:24.859632 31950 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:10:25.133921 29643 consensus_queue.cc:237] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:25.151260 29481 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 15:10:25.152774 31892 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:25.153586 29560 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260807 15:10:25.154906 29609 consensus_peers.cc:487] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 748d0394657643cfbf71e2bac60ff2f2. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:25.160239 31916 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:25.171761 31892 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.175248 29485 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.207012 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:25.203032 29382 catalog_manager.cc:5495] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.296962 29569 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:25.296667 29560 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.354279 29481 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:25.357256 31909 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:25.360039 29643 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260807 15:10:25.361001 29533 consensus_peers.cc:487] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1177fe2445db43e2b8366f33a841a041. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:25.361835 31909 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:25.390741 29481 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:25.391425 29481 raft_consensus.cc:595] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:25.403354 29481 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:25.404189 29481 raft_consensus.cc:595] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:25.405478 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 15:10:25.407594 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:25.408414 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:25.437531 31985 raft_consensus.cc:2932] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.449433 29485 raft_consensus.cc:2932] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.467525 29569 consensus_queue.cc:237] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:25.476890 29380 catalog_manager.cc:5495] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:25.481092 29643 raft_consensus.cc:2932] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.514072 29485 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 15:10:25.517808 29533 consensus_peers.cc:487] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3518672558d94e27a30f3efea0bbeab6. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:25.518824 31909 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:25.525362 29643 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:25.528046 31985 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:25.553064 31985 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.567710 29485 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.579102 29569 consensus_queue.cc:237] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:25.583634 32008 ts_tablet_manager.cc:927] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:25.590859 29382 catalog_manager.cc:5495] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:25.596050 29643 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
W20260807 15:10:25.628275 29533 consensus_peers.cc:487] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a -> Peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Couldn't send request to peer fbf78964d70448269802ac7de9d7a198. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81993fd783554e64b26c4f0c2344bf53. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:10:25.629077 29637 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:25.631203 31887 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:25.634282 32008 tablet_copy_client.cc:316] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.195:33653
I20260807 15:10:25.634829 29485 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:10:25.637917 31909 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 15:10:25.652057 31952 raft_consensus.cc:979] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:25.653936 31952 raft_consensus.cc:1067] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:25.662448 29658 tablet_copy_service.cc:140] P 4b092f7f951b4137b5d7810056684270: Received BeginTabletCopySession request for tablet 748d0394657643cfbf71e2bac60ff2f2 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:35570)
I20260807 15:10:25.663035 29658 tablet_copy_service.cc:161] P 4b092f7f951b4137b5d7810056684270: Beginning new tablet copy session on tablet 748d0394657643cfbf71e2bac60ff2f2 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:35570: session id = fbf78964d70448269802ac7de9d7a198-748d0394657643cfbf71e2bac60ff2f2
I20260807 15:10:25.663743 29643 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:25.664352 29643 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:25.664710 29643 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:25.673535 29658 tablet_copy_source_session.cc:205] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:25.671774 29643 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:25.676805 29643 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:25.677485 32008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 748d0394657643cfbf71e2bac60ff2f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:25.678009 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:25.678706 29481 raft_consensus.cc:3032] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:25.679111 29481 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:25.680018 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:25.680687 30306 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:25.684607 31909 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.684314 29481 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:25.689956 29481 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:25.699981 32008 tablet_copy_client.cc:791] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:25.700799 32008 tablet_copy_client.cc:655] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:25.703989 29643 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.707183 30306 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:25.708586 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:25.710008 31992 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:25.710561 31992 raft_consensus.cc:686] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:25.711524 31992 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:25.721419 32008 tablet_copy_client.cc:531] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:25.725777 29382 catalog_manager.cc:5495] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:25.747704 32008 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:25.752887 29378 catalog_manager.cc:5495] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 3, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:25.773313 29479 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fbf78964d70448269802ac7de9d7a198 (127.27.144.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } } }
I20260807 15:10:25.795529 32017 ts_tablet_manager.cc:927] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:25.801833 29481 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:25.844854 32008 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:25.846148 32008 tablet_bootstrap.cc:492] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:25.848500 32008 ts_tablet_manager.cc:1397] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.101s user 0.027s sys 0.033s
I20260807 15:10:25.851364 32008 raft_consensus.cc:348] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:25.852422 32008 raft_consensus.cc:729] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:25.853124 32008 consensus_queue.cc:260] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:25.855655 32008 ts_tablet_manager.cc:1428] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 15:10:25.872404 29658 tablet_copy_service.cc:342] P 4b092f7f951b4137b5d7810056684270: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-748d0394657643cfbf71e2bac60ff2f2 received from {username='slave'} at 127.0.0.1:35570
I20260807 15:10:25.872951 29658 tablet_copy_service.cc:433] P 4b092f7f951b4137b5d7810056684270: ending tablet copy session fbf78964d70448269802ac7de9d7a198-748d0394657643cfbf71e2bac60ff2f2 on tablet 748d0394657643cfbf71e2bac60ff2f2 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:25.885456 32017 tablet_copy_client.cc:316] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:10:25.887358 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 1177fe2445db43e2b8366f33a841a041 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:10:25.888017 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 1177fe2445db43e2b8366f33a841a041 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-1177fe2445db43e2b8366f33a841a041
I20260807 15:10:25.897152 31952 raft_consensus.cc:979] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:25.897835 31952 raft_consensus.cc:1067] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:25.898221 29579 tablet_copy_source_session.cc:205] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:25.899602 29644 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:25.900242 29644 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:25.900636 29644 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:25.905829 32017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1177fe2445db43e2b8366f33a841a041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:25.911700 29644 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:25.914361 29644 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:25.916625 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:25.917230 29481 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:25.917551 29481 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:25.918298 29481 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:25.919616 29481 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:25.924129 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:25.924826 30306 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:25.933852 32017 tablet_copy_client.cc:791] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:25.934653 32017 tablet_copy_client.cc:655] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:25.939049 29481 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:25.941401 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:25.941911 32017 tablet_copy_client.cc:531] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:25.942346 31916 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:25.942960 31916 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:25.943923 31916 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:25.955312 32017 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:25.972301 30306 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:25.974790 29382 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 5 to 6, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:25.994378 32017 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:25.995437 32017 tablet_bootstrap.cc:492] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:25.996251 32017 ts_tablet_manager.cc:1397] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.041s user 0.030s sys 0.005s
I20260807 15:10:25.999840 32017 raft_consensus.cc:348] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:26.000896 32017 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:26.001633 32017 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:26.004703 30306 raft_consensus.cc:1203] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260807 15:10:26.009215 32017 ts_tablet_manager.cc:1428] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.013s user 0.002s sys 0.005s
I20260807 15:10:26.011093 32008 ts_tablet_manager.cc:927] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:26.011973 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-1177fe2445db43e2b8366f33a841a041 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:10:26.012552 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-1177fe2445db43e2b8366f33a841a041 on tablet 1177fe2445db43e2b8366f33a841a041 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:26.024322 32008 tablet_copy_client.cc:316] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:10:26.023809 32023 ts_tablet_manager.cc:927] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: Initiating tablet copy from peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:26.026628 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 81993fd783554e64b26c4f0c2344bf53 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:10:26.027179 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 81993fd783554e64b26c4f0c2344bf53 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-81993fd783554e64b26c4f0c2344bf53
I20260807 15:10:26.036517 29579 tablet_copy_source_session.cc:205] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:26.049739 32023 tablet_copy_client.cc:316] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: tablet copy: Beginning tablet copy session from remote peer at address 127.27.144.194:33589
I20260807 15:10:26.050582 32008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81993fd783554e64b26c4f0c2344bf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:26.051873 29579 tablet_copy_service.cc:140] P 00dd11bf8fd9487580aba733c2996a4a: Received BeginTabletCopySession request for tablet 3518672558d94e27a30f3efea0bbeab6 from peer fbf78964d70448269802ac7de9d7a198 ({username='slave'} at 127.0.0.1:60682)
I20260807 15:10:26.052517 29579 tablet_copy_service.cc:161] P 00dd11bf8fd9487580aba733c2996a4a: Beginning new tablet copy session on tablet 3518672558d94e27a30f3efea0bbeab6 from peer fbf78964d70448269802ac7de9d7a198 at {username='slave'} at 127.0.0.1:60682: session id = fbf78964d70448269802ac7de9d7a198-3518672558d94e27a30f3efea0bbeab6
I20260807 15:10:26.063285 29579 tablet_copy_source_session.cc:205] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:10:26.067559 32023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3518672558d94e27a30f3efea0bbeab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:10:26.092592 32023 tablet_copy_client.cc:791] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:26.093418 32023 tablet_copy_client.cc:655] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:26.107041 32008 tablet_copy_client.cc:791] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 0 data blocks...
I20260807 15:10:26.108912 32008 tablet_copy_client.cc:655] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: tablet copy: Starting download of 1 WAL segments...
I20260807 15:10:26.109001 32023 tablet_copy_client.cc:531] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:26.121991 32023 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:26.152702 32008 tablet_copy_client.cc:531] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:10:26.155272 29481 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:26.191349 32008 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: Bootstrap starting.
I20260807 15:10:26.158865 31916 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260807 15:10:26.263516 30310 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:26.271927 31892 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260807 15:10:26.497293 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 155661us
I20260807 15:10:26.506013 30312 raft_consensus.cc:1203] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20260807 15:10:26.513680 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:26.558547 32023 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260807 15:10:26.614255 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 101386us
W20260807 15:10:26.617782 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 234385us
I20260807 15:10:26.633451 32023 tablet_bootstrap.cc:492] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:26.648990 32023 ts_tablet_manager.cc:1397] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.527s user 0.051s sys 0.054s
W20260807 15:10:26.767689 32008 log.cc:924] Time spent T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.072s user 0.000s sys 0.001s
I20260807 15:10:26.879467 30312 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:10:26.893807 32023 raft_consensus.cc:348] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:26.895526 32023 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
I20260807 15:10:26.973476 31892 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260807 15:10:27.005865 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 56553.2us
I20260807 15:10:26.951766 32023 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:27.048125 29485 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:10:27.027842 32008 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:10:27.028479 32037 raft_consensus.cc:1050] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:27.040483 29641 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:27.066898 29641 raft_consensus.cc:595] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:27.075378 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 65618.6us
W20260807 15:10:27.092715 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 80757.2us
I20260807 15:10:27.095338 32008 tablet_bootstrap.cc:492] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: Bootstrap complete.
I20260807 15:10:27.096603 32008 ts_tablet_manager.cc:1397] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: Time spent bootstrapping tablet: real 0.906s user 0.032s sys 0.054s
I20260807 15:10:27.067641 32023 ts_tablet_manager.cc:1428] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.418s user 0.009s sys 0.006s
I20260807 15:10:27.099392 30307 raft_consensus.cc:1203] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:10:27.071458 31892 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260807 15:10:27.105974 32037 consensus_queue.cc:237] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:27.111676 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 105459us
I20260807 15:10:27.172165 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-3518672558d94e27a30f3efea0bbeab6 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:10:27.182623 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-3518672558d94e27a30f3efea0bbeab6 on tablet 3518672558d94e27a30f3efea0bbeab6 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:27.147468 32008 raft_consensus.cc:348] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
W20260807 15:10:27.276993 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 130233us
I20260807 15:10:27.231403 32008 raft_consensus.cc:729] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Initialized, Role: LEARNER
W20260807 15:10:27.280233 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 115295us
I20260807 15:10:27.314268 29645 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:27.315052 29645 raft_consensus.cc:595] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:27.317993 32008 consensus_queue.cc:260] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: NON_VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: true } }
I20260807 15:10:27.322553 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 15:10:27.367830 32008 ts_tablet_manager.cc:1428] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: Time spent starting tablet: real 0.271s user 0.009s sys 0.005s
I20260807 15:10:27.368538 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:27.369735 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:27.370607 29579 tablet_copy_service.cc:342] P 00dd11bf8fd9487580aba733c2996a4a: Request end of tablet copy session fbf78964d70448269802ac7de9d7a198-81993fd783554e64b26c4f0c2344bf53 received from {username='slave'} at 127.0.0.1:60682
I20260807 15:10:27.371438 29579 tablet_copy_service.cc:433] P 00dd11bf8fd9487580aba733c2996a4a: ending tablet copy session fbf78964d70448269802ac7de9d7a198-81993fd783554e64b26c4f0c2344bf53 on tablet 81993fd783554e64b26c4f0c2344bf53 with peer fbf78964d70448269802ac7de9d7a198
I20260807 15:10:27.375039 32003 raft_consensus.cc:1050] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
W20260807 15:10:27.386837 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 239358us
I20260807 15:10:27.384384 32003 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:27.410741 32079 log.cc:924] Time spent T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.055s user 0.003s sys 0.000s
I20260807 15:10:27.422566 32030 raft_consensus.cc:1050] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:27.426258 30307 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 LEARNER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:27.426584 32030 consensus_queue.cc:237] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:27.434919 29485 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:27.473978 30307 raft_consensus.cc:1203] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 15:10:27.487886 29569 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 15:10:27.492139 32043 raft_consensus.cc:979] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:27.492935 32043 raft_consensus.cc:1067] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:27.506374 31916 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:27.509215 32067 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:27.510543 31916 raft_consensus.cc:979] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:27.568185 32071 raft_consensus.cc:1067] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:27.571352 32043 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:27.587023 29483 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:27.587708 29483 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:27.588099 29483 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:27.606247 29485 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:27.607059 29485 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:27.607508 29485 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:27.606617 29483 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:27.617610 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 67094us
I20260807 15:10:27.652714 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:27.653798 29568 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:27.661623 29485 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:27.663631 29483 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:27.669443 29485 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:27.684804 29568 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:27.698221 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:27.699003 29647 raft_consensus.cc:3032] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:27.699342 29647 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:27.700170 29647 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:27.701584 29647 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:27.694124 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:27.704630 29645 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:27.707473 29480 raft_consensus.cc:1226] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:27.704967 29645 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:27.712553 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:27.717698 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 43869us
I20260807 15:10:27.721053 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:27.721719 30307 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:27.721524 29645 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:27.729753 29645 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:27.734483 30306 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:27.745761 30307 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:27.731094 32066 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:27.753032 29452 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:27.756561 30307 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:27.761844 32058 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:27.762516 32058 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:27.772527 32058 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:27.777968 31909 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:27.791085 29645 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:27.768018 32066 raft_consensus.cc:686] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:27.810490 29488 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:27.818496 29647 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:27.767414 32003 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260807 15:10:27.842777 32046 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260807 15:10:27.876070 32048 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:27.892674 29647 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:27.898202 30307 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:27.910627 29569 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:27.825917 32066 consensus_queue.cc:237] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:27.935469 29643 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260807 15:10:27.942242 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 108126us
I20260807 15:10:27.955613 29486 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:27.959619 32031 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260807 15:10:27.962445 29378 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 5 to 6, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 6 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:27.963281 29379 catalog_manager.cc:5495] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 reported cstate change: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:27.952298 31985 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260807 15:10:27.977350 32069 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:28.046829 31909 raft_consensus.cc:1050] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a: attempting to promote NON_VOTER fbf78964d70448269802ac7de9d7a198 to VOTER
I20260807 15:10:28.175916 29646 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:28.160856 31887 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:28.300483 30312 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260807 15:10:28.300235 29487 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:28.303990 29643 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260807 15:10:28.300565 32094 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.134s user 0.000s sys 0.002s
W20260807 15:10:28.311529 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 90265.1us
I20260807 15:10:28.328469 32076 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 15:10:28.334085 32069 raft_consensus.cc:2932] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:28.360790 30312 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:28.365900 32039 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260807 15:10:28.358162 29487 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:28.356077 29644 raft_consensus.cc:2932] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:28.211921 31909 consensus_queue.cc:237] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:28.400717 29480 raft_consensus.cc:2932] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:28.494216 30307 raft_consensus.cc:2932] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:28.545369 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 237575us
I20260807 15:10:28.551743 29487 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:28.552665 30306 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:28.581853 32030 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260807 15:10:28.592916 32046 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260807 15:10:28.616534 29643 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 15:10:28.619619 29564 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:28.627002 32070 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260807 15:10:28.683869 29647 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260807 15:10:28.733328 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 131446us
I20260807 15:10:28.745793 32027 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260807 15:10:28.758823 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 143708us
I20260807 15:10:28.777283 31909 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260807 15:10:28.816932 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:29.740475 29379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 215) took 1794 ms. Trace:
I20260807 15:10:29.741019 29379 rpcz_store.cc:276] 0807 15:10:27.936891 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:27.937081 (+ 190us) service_pool.cc:227] Handling call
0807 15:10:29.730854 (+1793773us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:28.514206 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:28.514743 (+ 537us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:28.514781 (+ 38us) write_op.cc:435] Acquired schema lock
0807 15:10:28.514800 (+ 19us) tablet.cc:660] Decoding operations
0807 15:10:28.515145 (+ 345us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:28.515196 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:28.515222 (+ 26us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:10:28.515421 (+ 199us) tablet.cc:699] Row locks acquired
0807 15:10:28.515441 (+ 20us) write_op.cc:260] PREPARE: finished
0807 15:10:28.515595 (+ 154us) write_op.cc:270] Start()
0807 15:10:28.515727 (+ 132us) write_op.cc:276] Timestamp: P: 1786115428515544 usec, L: 0
0807 15:10:28.515747 (+ 20us) op_driver.cc:331] REPLICATION: starting
0807 15:10:28.516440 (+ 693us) log.cc:842] Serialized 603 byte log entry
0807 15:10:28.733678 (+217238us) op_driver.cc:444] REPLICATION: finished
0807 15:10:28.755123 (+ 21445us) write_op.cc:301] APPLY: starting
0807 15:10:28.758126 (+ 3003us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:28.763043 (+ 4917us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:28.763148 (+ 105us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:28.763353 (+ 205us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:28.788182 (+ 24829us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:10:28.788238 (+ 56us) write_op.cc:312] APPLY: finished
0807 15:10:28.788452 (+ 214us) log.cc:842] Serialized 23 byte log entry
0807 15:10:28.788649 (+ 197us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:28.788792 (+ 143us) write_op.cc:454] Released schema lock
0807 15:10:28.788851 (+ 59us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:28.789216 (+ 365us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:28.789243 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":8528,"apply.run_cpu_time_us":2240,"apply.run_wall_time_us":34905,"num_ops":1,"prepare.queue_time_us":526539,"prepare.run_cpu_time_us":2494,"prepare.run_wall_time_us":2494,"replication_time_us":216038}]]}
I20260807 15:10:29.789892 32076 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.791003 32076 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.796496 32076 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:29.801925 32076 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.803058 32076 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:29.808137 29414 debug-util.cc:398] Leaking SignalData structure 0x7b0800136d20 after lost signal to thread 28230
I20260807 15:10:29.808422 32076 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:29.810344 29414 debug-util.cc:398] Leaking SignalData structure 0x7b080029dcc0 after lost signal to thread 29417
I20260807 15:10:29.825577 32085 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.826602 32085 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:29.831318 29647 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s user 0.015s sys 0.029s
W20260807 15:10:29.832401 29647 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s user 0.016s sys 0.030s
I20260807 15:10:29.832286 32085 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:29.853628 29380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 369) took 1106 ms. Trace:
W20260807 15:10:29.855244 29568 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.097s user 0.010s sys 0.000s
W20260807 15:10:29.860932 29568 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.103s user 0.011s sys 0.000s
I20260807 15:10:29.855737 29380 rpcz_store.cc:276] 0807 15:10:28.747134 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:28.747403 (+ 269us) service_pool.cc:227] Handling call
0807 15:10:29.853399 (+1105996us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260807 15:10:29.888083 32123 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.895460 32065 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:29.896564 32065 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.897833 32124 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.898952 32124 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:29.902369 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 1.13803e+06us
I20260807 15:10:29.912487 31953 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.913625 32069 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.914630 32069 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.916275 32029 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.917006 32029 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.917411 32046 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.889117 32123 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:29.918363 32046 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:29.913722 32085 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.920797 32123 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:29.921080 32076 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.920869 32085 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:29.921432 32123 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.921820 32076 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.922147 32123 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:29.923254 32085 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:29.926110 32069 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:29.917996 32065 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:29.928143 32046 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:29.928915 31953 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.929576 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:29.932754 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 1973) took 1160 ms. Trace:
I20260807 15:10:29.932782 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 1972) took 1176 ms. Trace:
I20260807 15:10:29.934186 29568 rpcz_store.cc:276] 0807 15:10:28.756293 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:28.756968 (+ 675us) service_pool.cc:227] Handling call
0807 15:10:28.757234 (+ 266us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:28.757455 (+ 221us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 15:10:29.861551 (+1104096us) log.cc:842] Serialized 14 byte log entry
0807 15:10:29.932311 (+ 70760us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:29.932376 (+ 65us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:29.932457 (+ 81us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:29.932543 (+ 86us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:29.932708 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40077,"prepare.queue_time_us":610865,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":40272,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"thread_start_us":1133245,"threads_started":2}
I20260807 15:10:29.935570 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:29.937013 29414 debug-util.cc:398] Leaking SignalData structure 0x7b080030a580 after lost signal to thread 29514
W20260807 15:10:29.937379 29414 debug-util.cc:398] Leaking SignalData structure 0x7b080030da40 after lost signal to thread 29515
W20260807 15:10:29.938544 29414 debug-util.cc:398] Leaking SignalData structure 0x7b080035cb80 after lost signal to thread 29594
W20260807 15:10:29.938902 29414 debug-util.cc:398] Leaking SignalData structure 0x7b08000afc40 after lost signal to thread 29595
I20260807 15:10:29.938966 29382 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48690 (request call id 384) took 1859 ms. Trace:
I20260807 15:10:29.939412 29382 rpcz_store.cc:276] 0807 15:10:28.079628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:28.079760 (+ 132us) service_pool.cc:227] Handling call
0807 15:10:29.938738 (+1858978us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":894,"reported_tablets":1}
W20260807 15:10:29.940102 29414 debug-util.cc:398] Leaking SignalData structure 0x7b080036ed60 after lost signal to thread 29674
W20260807 15:10:29.940435 29414 debug-util.cc:398] Leaking SignalData structure 0x7b0800284080 after lost signal to thread 29676
W20260807 15:10:29.941645 29414 debug-util.cc:398] Leaking SignalData structure 0x7b0800322ce0 after lost signal to thread 30341
W20260807 15:10:29.941910 29414 debug-util.cc:398] Leaking SignalData structure 0x7b0800317660 after lost signal to thread 30342
I20260807 15:10:29.941126 29378 catalog_manager.cc:5495] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 2 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:29.944808 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:29.944824 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 373940us
I20260807 15:10:29.933357 29569 rpcz_store.cc:276] 0807 15:10:28.772156 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:28.772298 (+ 142us) service_pool.cc:227] Handling call
0807 15:10:29.931578 (+1159280us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:29.932077 (+ 499us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:29.932120 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:29.932173 (+ 53us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:10:29.932228 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:29.932305 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:29.932458 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:29.935734 31953 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:29.956632 32116 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:29.957568 32116 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.943773 29378 catalog_manager.cc:5495] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:29.976455 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:29.976346 32059 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.979247 32036 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.974730 32045 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.978343 32123 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:29.985392 29647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2183) took 1221 ms. Trace:
I20260807 15:10:29.988857 31887 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:29.988989 32054 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.989046 32071 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:29.989563 31887 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:29.989832 32071 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.991990 32125 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.992061 31961 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.992728 32125 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.992820 31961 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.989602 32054 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.999495 32031 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:29.999876 32054 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:29.999616 32045 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.000662 32035 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.000419 32031 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.001314 32035 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:29.981240 32029 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.009439 32116 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.010416 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.012166 32105 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:29.986932 29647 rpcz_store.cc:276] 0807 15:10:28.762095 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:28.762260 (+ 165us) service_pool.cc:227] Handling call
0807 15:10:28.762611 (+ 351us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:28.762952 (+ 341us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:28.762981 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:28.763435 (+ 454us) log.cc:842] Serialized 26 byte log entry
0807 15:10:29.833577 (+1070142us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:29.951054 (+117477us) log.cc:842] Serialized 14 byte log entry
0807 15:10:29.966405 (+ 15351us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:29.969147 (+ 2742us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:29.971365 (+ 2218us) raft_consensus.cc:1671] finished
0807 15:10:29.971390 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:29.983750 (+ 12360us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1772,"raft.queue_time_us":4168,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":10207,"thread_start_us":1127954,"threads_started":2,"wal-append.queue_time_us":633177}
I20260807 15:10:29.979615 32059 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.012933 32105 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.019187 32105 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.019520 32045 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.013772 31961 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.020035 32059 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.007287 32036 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.020784 32046 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.021611 32060 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.021449 32046 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.022253 32036 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.006186 32076 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.022311 32060 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.007737 32124 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.025933 32031 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.023155 31887 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.027141 32116 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.027290 32071 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.027943 32071 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.027837 32116 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.028566 32071 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.029980 32035 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.030800 32116 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.031291 32071 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.002661 32125 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.039024 31909 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.059518 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.040705 32044 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.060354 29481 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:30.040699 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.042393 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.042817 32089 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.043131 32051 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.043598 32069 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.043804 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.044224 31887 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.044443 32016 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.063916 32044 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.048044 32031 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.048424 32046 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.056149 32060 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.042048 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.060120 32128 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.064081 32045 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:29.988346 29378 catalog_manager.cc:5495] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 3 to 4, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:30.072759 31985 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.077550 30310 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:30.064603 32035 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.064854 31953 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.073369 32003 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.073719 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.074177 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.075181 32132 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.083349 32124 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.077827 32071 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.074494 32069 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.074883 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.090497 32035 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.092474 32044 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.060189 31909 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.088706 32132 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.089591 32045 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.094908 31909 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.081283 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.095659 32045 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.095300 32003 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.074620 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.064309 32089 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.083316 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.083428 31985 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.084053 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.083987 31887 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.084296 32031 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.083398 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.087970 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.092583 32069 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.074631 32051 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.102087 32003 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.102823 32089 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.103068 32066 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.103389 32051 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.089331 32124 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.097656 29483 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:30.103780 32066 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.105654 32051 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.105774 32124 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.083617 32128 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.106374 31887 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.106284 32051 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.074962 32131 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.108186 32128 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.108577 32031 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.106688 32066 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.089103 32048 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.087033 32105 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.115482 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.115855 32105 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.115501 31985 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.117156 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.120230 30306 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:30.118026 32031 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.121296 32105 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.113091 31953 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.100327 32060 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.118059 32045 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.116268 29483 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:30.121009 32031 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.128075 32066 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.118499 32048 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.128823 32060 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.128957 32066 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.129621 32031 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.130339 32125 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.131296 32060 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.130946 32125 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.108429 32131 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.132522 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.133080 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.133483 32125 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.124640 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.128153 30274 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.134227 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.126912 32071 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.135847 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.136433 31961 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:30.081660 32016 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.136885 31961 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.095120 32132 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.137540 32048 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.137619 31961 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.137943 32051 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.139762 32035 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.137660 30312 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
I20260807 15:10:30.143379 32066 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.144163 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.145203 32131 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.145929 29483 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:30.144704 32016 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.145931 32071 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.160384 32031 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.161125 32031 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.162582 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.165970 32060 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.167079 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.166832 32060 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.170255 32060 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.172017 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.172633 29609 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.173772 32134 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:30.175438 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.175767 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.176753 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.177110 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.178215 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.178454 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.174240 32134 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.179539 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.180032 32134 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.180269 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.175871 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.180794 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.163559 32031 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.172730 29641 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:30.184499 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.184803 30274 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.187624 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.188799 32035 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:30.189308 32035 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.187667 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.186772 32045 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.188421 32066 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.190303 32066 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.190603 32125 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.190646 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.193554 31953 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.193686 32125 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.195246 32066 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.189775 32035 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:30.199823 32045 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.200335 32125 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.201999 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.203087 30312 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:30.205041 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.208698 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.207274 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.209957 29483 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:30.210806 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.211483 30306 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:30.209873 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.215857 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.220850 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.222031 32137 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.223119 32137 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.229526 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.229581 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.230829 29566 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:30.229485 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.237035 31961 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.244223 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.237335 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.244890 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.240903 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.241313 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.243053 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.243562 29609 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:30.247768 32060 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:30.250527 32045 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.249428 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:30.252287 31961 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.252149 32035 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.252971 32060 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:30.253575 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.251279 32045 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.254510 29566 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:10:30.254608 29609 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:30.255625 32060 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:30.256800 31961 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.257160 32051 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:30.258858 29609 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:30.259672 32060 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:30.261273 29609 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:30.261438 32131 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.261670 31961 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.262060 32131 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.263290 32045 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.261468 32029 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.264771 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.265236 32029 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.266292 29609 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.267400 32071 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:30.267524 32035 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.267797 32071 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.268226 32071 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.271293 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.272392 31961 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.262071 32060 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:30.274555 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:30.275763 29488 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.274569 32060 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.278577 32060 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:30.275120 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:30.280347 29481 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:30.282629 29609 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.281857 32029 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.284010 32131 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.285048 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.285910 29486 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:30.283601 32124 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:30.283545 32031 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.287488 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.289703 32048 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:30.290855 32048 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.291240 32048 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:30.287541 32124 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.289667 32031 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.297766 32066 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:30.264227 32134 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.340596 32071 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.341410 32031 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.330933 29481 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:30.334635 29488 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:30.344580 32066 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.345415 29608 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.346598 29608 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.346735 32066 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.346649 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:30.347416 29486 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.302055 32137 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.347935 32116 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:30.346750 31992 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:30.348578 32071 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.349437 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:30.350632 30306 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.301201 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.350028 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.351855 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.353108 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.353464 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.353705 29644 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:30.354471 29644 raft_consensus.cc:595] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:30.354791 29644 raft_consensus.cc:603] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:10:30.353173 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.355307 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.355767 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.355983 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:30.357642 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:30.359862 29486 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:30.362694 30274 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.363018 32124 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.364948 32045 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:30.366003 32045 raft_consensus.cc:686] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:30.368800 32045 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.367452 29608 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.371523 29608 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:30.337683 29531 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:30.369971 30306 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:30.372803 30274 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.374056 29608 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.373538 29609 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.374903 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.377355 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.380267 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.377115 32105 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:30.385159 32105 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.385509 32105 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:30.373792 32071 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:30.391062 32134 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.392782 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:30.393594 30306 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.396276 29486 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:30.397006 29486 raft_consensus.cc:595] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:10:30.398989 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 15:10:30.362959 32060 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.400880 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:30.401872 32060 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.386623 31961 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:30.402776 31961 raft_consensus.cc:686] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:30.403613 31961 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.405614 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:30.377223 32116 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:30.405246 32071 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.410799 32071 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:30.410704 30306 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:30.413214 29609 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.418888 29645 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:30.420723 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.421356 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.421942 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.377372 32031 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:30.429189 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:30.429291 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.433393 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:30.434059 29486 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:30.435220 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.436935 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.436717 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.445508 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:30.448841 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.425215 32116 raft_consensus.cc:686] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:30.431829 32059 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:30.428664 32031 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:30.462963 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.463758 29647 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:30.464591 32116 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.466362 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.464639 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.496737 29531 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:30.496902 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.522821 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.525933 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:30.553786 32135 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:10:30.545432 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 48815.7us
I20260807 15:10:30.564960 31887 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:30.565513 31887 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:30.565928 31887 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.501658 32031 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:30.571592 32071 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.651242 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.649924 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.659199 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.659917 32105 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.660671 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.661051 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:30.662122 32136 log.cc:924] Time spent T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.097s user 0.008s sys 0.000s
I20260807 15:10:30.662845 32105 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:30.674016 29486 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:10:30.677644 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 181083us
I20260807 15:10:30.680075 29640 raft_consensus.cc:1226] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:30.686357 32071 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.695392 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:30.699854 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:30.694984 32059 raft_consensus.cc:686] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:30.703097 32059 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.708989 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.711859 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:30.718116 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:30.715214 29609 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:30.724164 29609 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.725463 29609 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:30.727236 29642 raft_consensus.cc:1226] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:30.729122 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.729432 29642 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:30.729578 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.730158 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.727267 32048 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.727129 32105 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:30.740206 32134 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:30.740358 29646 raft_consensus.cc:1226] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:30.740829 32134 raft_consensus.cc:686] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:30.739599 32048 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.741900 32134 consensus_queue.cc:237] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.740370 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.727434 32036 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:10:30.748375 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.748555 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.748963 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.740761 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:30.750607 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.757236 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:30.758214 30312 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:30.775545 30272 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.776639 32029 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:30.777700 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 71121us
I20260807 15:10:30.783742 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:30.789857 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 98690.9us
I20260807 15:10:30.794346 30308 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:30.802280 29483 raft_consensus.cc:1226] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:30.803774 32016 consensus_queue.cc:1046] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:30.804715 32016 consensus_queue.cc:1225] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer 4b092f7f951b4137b5d7810056684270 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260807 15:10:30.805255 32016 raft_consensus.cc:3032] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:30.805573 32016 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:30.806385 32016 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.798496 32051 consensus_queue.cc:1046] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260807 15:10:30.808961 32051 raft_consensus.cc:3032] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:30.809288 32051 raft_consensus.cc:729] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:30.809633 30307 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:30.810077 32051 consensus_queue.cc:260] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.811442 32051 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:30.812670 29483 raft_consensus.cc:1226] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:30.822067 29449 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:30.823421 32076 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:30.828511 29486 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:30.830410 31985 consensus_queue.cc:1046] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:30.831813 32137 raft_consensus.cc:3032] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:30.832355 32137 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:30.833361 32137 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.834885 32137 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:30.835572 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50105.8us
I20260807 15:10:30.782660 31887 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:30.840512 31887 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:30.807758 32016 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.849432 30272 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.851539 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.854197 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:30.854912 29644 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:30.856717 30272 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.856583 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.855463 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.859390 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:30.864353 30307 raft_consensus.cc:1226] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:30.852960 32054 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:30.872969 29645 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:30.860913 32125 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:30.884459 30310 raft_consensus.cc:1226] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:30.886821 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.887315 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.888422 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.888752 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:30.864087 31961 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:10:30.890116 32147 log.cc:924] Time spent T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.097s user 0.001s sys 0.000s
I20260807 15:10:30.890491 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.862846 32035 consensus_queue.cc:1046] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260807 15:10:30.894047 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.901993 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.906616 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.906965 30312 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:30.907814 30308 raft_consensus.cc:1226] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:30.899616 32035 raft_consensus.cc:3032] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:30.908636 32035 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:30.909545 32035 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.909847 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:30.910421 32035 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:30.917865 31887 consensus_queue.cc:1046] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:30.919171 29644 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:30.919847 31887 consensus_queue.cc:1225] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer 4b092f7f951b4137b5d7810056684270 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260807 15:10:30.904402 32031 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.922870 32031 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:30.926142 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:30.927368 29531 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:30.927672 32066 raft_consensus.cc:979] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:30.928256 32066 raft_consensus.cc:1067] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Signalling peer 4b092f7f951b4137b5d7810056684270 to start an election
I20260807 15:10:30.928330 32031 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:30.928928 32031 raft_consensus.cc:686] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:30.931875 29644 raft_consensus.cc:2379] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
W20260807 15:10:30.934406 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 79134.6us
I20260807 15:10:30.948498 29488 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:30.948609 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.948282 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.958842 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.957829 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.961303 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.962086 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:30.963311 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 104004us
I20260807 15:10:30.963403 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.962853 29487 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:10:30.962121 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.972972 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.975245 29609 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:30.975371 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.981928 32080 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:30.982506 32080 raft_consensus.cc:686] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:30.982551 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.986243 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.989303 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.983973 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:31.001506 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:31.004477 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:30.961018 32125 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260807 15:10:31.002853 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.983534 32080 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:30.962708 32031 consensus_queue.cc:237] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:31.006892 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:30.998754 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:31.024349 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:31.032805 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 150416us
I20260807 15:10:31.034320 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:31.039788 29449 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.042747 32131 consensus_queue.cc:1046] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:31.043639 31985 raft_consensus.cc:3032] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:31.044139 31985 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:31.044260 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:31.065168 29483 raft_consensus.cc:1226] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:31.068173 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:31.069916 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:31.071045 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:31.073850 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:31.054318 32128 raft_consensus.cc:3032] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:31.057441 32076 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.085346 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:31.101351 29450 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.096844 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:31.089313 32128 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:31.116438 29450 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.118094 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.119475 29450 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.120339 32145 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.121681 29450 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.122473 32145 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.122943 32124 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.123651 29450 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.124706 32124 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.127799 29450 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.129105 29450 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.129748 29382 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 216) took 1056 ms. Trace:
I20260807 15:10:31.130134 29382 rpcz_store.cc:276] 0807 15:10:30.073687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:30.073873 (+ 186us) service_pool.cc:227] Handling call
0807 15:10:31.129694 (+1055821us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":3}
I20260807 15:10:31.132295 29450 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.117805 32065 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.140815 32128 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.133891 32124 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.141974 32145 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:31.102594 31985 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.132105 32135 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:31.143710 32135 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:31.145798 32135 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:31.150168 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:31.141153 29643 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:59988
I20260807 15:10:31.151672 29643 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:31.152225 29643 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:31.157361 29567 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
W20260807 15:10:31.164372 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 84305.6us
I20260807 15:10:31.162652 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 364) took 2395 ms. Trace:
I20260807 15:10:31.170868 30309 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:31.173322 30273 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.127408 32161 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.175478 29450 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:10:31.178710 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 86133.7us
I20260807 15:10:31.179636 32145 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.189640 31985 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:31.175606 30273 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.191550 30273 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.192864 32029 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.168241 29378 rpcz_store.cc:276] 0807 15:10:28.736383 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:28.737141 (+ 758us) service_pool.cc:227] Handling call
0807 15:10:31.132063 (+2394922us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:30.204099 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:30.204949 (+ 850us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:30.205010 (+ 61us) write_op.cc:435] Acquired schema lock
0807 15:10:30.205029 (+ 19us) tablet.cc:660] Decoding operations
0807 15:10:30.216417 (+ 11388us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:30.216642 (+ 225us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:30.216689 (+ 47us) tablet.cc:683] Acquiring locks for 3 operations
0807 15:10:30.217367 (+ 678us) tablet.cc:699] Row locks acquired
0807 15:10:30.217411 (+ 44us) write_op.cc:260] PREPARE: finished
0807 15:10:30.217615 (+ 204us) write_op.cc:270] Start()
0807 15:10:30.217798 (+ 183us) write_op.cc:276] Timestamp: P: 1786115430217539 usec, L: 0
0807 15:10:30.217840 (+ 42us) op_driver.cc:331] REPLICATION: starting
0807 15:10:30.288876 (+ 71036us) log.cc:842] Serialized 1444 byte log entry
0807 15:10:30.866439 (+577563us) op_driver.cc:444] REPLICATION: finished
0807 15:10:30.977765 (+111326us) write_op.cc:301] APPLY: starting
0807 15:10:30.977881 (+ 116us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:30.978052 (+ 171us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:30.978210 (+ 158us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:30.978853 (+ 643us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:30.979252 (+ 399us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0807 15:10:30.979297 (+ 45us) write_op.cc:312] APPLY: finished
0807 15:10:31.056603 (+ 77306us) log.cc:842] Serialized 35 byte log entry
0807 15:10:31.075659 (+ 19056us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:31.075792 (+ 133us) write_op.cc:454] Released schema lock
0807 15:10:31.075878 (+ 86us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:31.076325 (+ 447us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:31.076352 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":211086,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":110896,"apply.run_cpu_time_us":3615,"apply.run_wall_time_us":98880,"num_ops":3,"prepare.queue_time_us":74260,"prepare.run_cpu_time_us":42595,"prepare.run_wall_time_us":235504,"raft.queue_time_us":127610,"raft.run_cpu_time_us":10865,"raft.run_wall_time_us":111340,"replication_time_us":648479,"spinlock_wait_cycles":42368,"thread_start_us":352538,"threads_started":4,"wal-append.queue_time_us":381662}]]}
I20260807 15:10:31.193361 32125 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.182292 32128 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:31.180932 32155 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.199075 30273 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.201143 30273 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.204151 32155 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.205920 29450 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.206269 32066 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.206841 32066 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.207015 29483 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:31.207147 29450 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.208369 29450 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.208956 32161 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.210031 32124 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.212388 29645 raft_consensus.cc:1226] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:31.213948 29450 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.214226 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:31.215171 29450 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.215880 32076 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.216481 32076 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.222837 32162 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.222988 29382 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 4 to 5, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 5 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:31.225054 30273 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.226214 32155 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.225972 29382 catalog_manager.cc:5495] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 4 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:31.227830 29483 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 15:10:31.229656 29609 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:31.230479 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 125176us
I20260807 15:10:31.231537 32135 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.200405 29643 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.232203 32076 consensus_queue.cc:1046] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:31.234063 32066 raft_consensus.cc:3032] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:31.234406 32066 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:31.234612 29643 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:31.236236 29533 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.229655 30273 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.237871 30273 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.235314 32066 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:31.240816 32051 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.237819 29533 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.242745 32135 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:10:31.245599 29567 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 15:10:31.248364 32051 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.244135 32162 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.241501 32125 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.241585 32066 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:31.253983 32151 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:31.247978 29533 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:31.256494 32167 log.cc:924] Time spent T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.076s user 0.000s sys 0.001s
I20260807 15:10:31.256620 32051 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.258179 29533 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.258950 32051 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.264081 29644 consensus_queue.cc:237] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.265439 29533 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:31.266579 32031 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:31.266979 32031 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:31.268673 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:31.269081 29533 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.271308 30305 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 15:10:31.284866 30306 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:31.286362 32155 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:10:31.288681 32031 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:31.293134 29533 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.279264 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:31.294646 29488 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:10:31.294970 29488 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:31.296587 29533 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.298134 32137 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.295511 32051 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.302866 29560 raft_consensus.cc:1261] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:10:31.304626 32137 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.306845 32135 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:31.310271 29533 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.299154 29488 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.312674 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.320986 30306 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:31.325588 32137 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.335954 29533 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:31.336880 32137 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.338716 32137 consensus_queue.cc:1046] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:10:31.298158 29379 catalog_manager.cc:5495] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:31.341620 29488 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:31.342373 29379 catalog_manager.cc:5495] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 reported cstate change: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:31.347060 29379 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:31.349646 29379 catalog_manager.cc:5495] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 5 to 6, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:31.351873 29379 catalog_manager.cc:5495] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 5, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:31.344867 32051 raft_consensus.cc:3032] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:31.341378 32128 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.408583 29533 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.409299 29488 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:31.409559 31887 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.398865 32051 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:31.426091 29533 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:31.437672 32171 log.cc:924] Time spent T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.098s user 0.002s sys 0.000s
I20260807 15:10:31.443331 31887 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:31.448925 31887 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.451958 31887 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:31.409603 32128 consensus_queue.cc:1046] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260807 15:10:31.454502 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 108217us
I20260807 15:10:31.455109 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.458813 32128 consensus_queue.cc:1225] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer fbf78964d70448269802ac7de9d7a198 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260807 15:10:31.459733 32128 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.464421 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.466737 32137 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.468775 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.469714 32137 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.472059 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.473045 32137 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.474411 29533 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.480324 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:31.483129 32105 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260807 15:10:31.497587 29641 raft_consensus.cc:1226] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:31.512894 29565 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:31.465190 31887 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.510991 29533 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.518532 30306 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:31.525110 29561 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:31.527731 30305 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:31.529575 32128 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.530004 29533 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.472052 32051 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.531749 29533 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.533154 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.541234 32134 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:31.546093 29533 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.510444 32135 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:10:31.510085 32163 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.560599 29481 raft_consensus.cc:1261] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:10:31.544103 32137 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:31.548542 32161 consensus_queue.cc:1046] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260807 15:10:31.581730 29570 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:31.570518 32105 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:31.534552 32031 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:31.573590 32080 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:31.532182 32051 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:31.532266 32160 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.588667 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:31.536476 32128 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:31.587548 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:31.590081 32135 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:31.613070 29487 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:31.634907 29567 raft_consensus.cc:1226] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:31.590108 32131 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:31.643661 30309 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:31.639381 29561 consensus_queue.cc:237] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.706293 29569 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:10:31.630434 32151 consensus_queue.cc:1035] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260807 15:10:31.715446 29564 raft_consensus.cc:1226] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:31.714200 32137 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:31.635488 32143 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260807 15:10:31.645916 32071 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260807 15:10:31.732163 32135 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.723014 32137 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:31.749979 32137 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:31.750399 32076 raft_consensus.cc:3032] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:31.750980 32076 raft_consensus.cc:729] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:31.760233 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:31.724030 30305 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fbf78964d70448269802ac7de9d7a198 (127.27.144.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:31.763837 32031 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:31.772939 32066 consensus_meta.cc:287] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.520s user 0.013s sys 0.000s
I20260807 15:10:31.774886 29481 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 15:10:31.779317 32139 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.092s user 0.001s sys 0.000s
I20260807 15:10:31.779663 32156 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260807 15:10:31.785380 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:31.743604 32134 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260807 15:10:31.802757 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:10:31.827754 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 46580.5us
W20260807 15:10:31.846114 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 63795.4us
I20260807 15:10:31.855733 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:31.856247 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:31.859347 31985 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:31.872519 32135 consensus_queue.cc:1046] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260807 15:10:31.890853 32177 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.138s user 0.001s sys 0.000s
W20260807 15:10:31.774415 29366 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 1177fe2445db43e2b8366f33a841a041 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 00dd11bf8fd9487580aba733c2996a4a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:31.908711 29366 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 134478us
I20260807 15:10:31.928694 29570 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:31.853319 32076 consensus_queue.cc:260] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:31.981827 32076 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:10:31.984543 32186 log.cc:924] Time spent T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.148s user 0.002s sys 0.006s
W20260807 15:10:32.004058 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 54027.1us
I20260807 15:10:32.008785 32143 raft_consensus.cc:3032] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:32.009375 32143 raft_consensus.cc:729] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:32.010335 32143 consensus_queue.cc:260] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:32.011752 32143 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:10:32.073284 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 211236us
I20260807 15:10:32.087002 29531 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:32.084530 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 226947us
I20260807 15:10:32.113093 30311 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260807 15:10:32.215328 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 110001us
I20260807 15:10:32.217285 29533 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:32.218828 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 135810us
W20260807 15:10:32.230420 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 88449.9us
I20260807 15:10:32.264438 32132 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:32.267047 32016 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 15:10:32.304636 32191 log.cc:924] Time spent T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.054s user 0.000s sys 0.002s
W20260807 15:10:32.326205 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 244865us
I20260807 15:10:32.362661 32210 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260807 15:10:32.387367 29487 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260807 15:10:32.383445 32156 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:32.400699 29640 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:32.415750 30312 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260807 15:10:32.423244 32161 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:32.428612 32161 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:32.427460 32163 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260807 15:10:32.435215 32161 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:32.436302 32036 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:32.437975 32036 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:32.441885 32036 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:32.444214 32214 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260807 15:10:32.455010 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:32.458250 29641 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 15:10:32.455993 30310 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:32.395681 32156 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:32.504154 29609 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:32.508261 32213 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:32.491204 32071 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260807 15:10:32.501915 32160 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260807 15:10:32.552531 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 275218us
I20260807 15:10:32.562127 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:32.564199 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 345490us
I20260807 15:10:32.535395 32213 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:32.582990 32156 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:32.593375 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:32.601531 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 382878us
I20260807 15:10:32.579152 32213 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:10:32.589684 32184 log.cc:924] Time spent T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.051s user 0.002s sys 0.000s
I20260807 15:10:32.600198 30272 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:32.629531 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:32.647344 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:32.648097 29569 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:32.593493 32016 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260807 15:10:32.658412 32152 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:32.727566 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 110418us
I20260807 15:10:32.670578 32152 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:32.753670 29380 catalog_manager.cc:5495] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:32.750638 32162 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260807 15:10:32.769260 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:32.780586 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:32.792965 32223 log.cc:924] Time spent T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260807 15:10:32.798098 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2540) took 1055 ms. Trace:
I20260807 15:10:32.801308 29566 rpcz_store.cc:276] 0807 15:10:31.742562 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:31.742742 (+ 180us) service_pool.cc:227] Handling call
0807 15:10:31.745245 (+ 2503us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:31.745630 (+ 385us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:31.745672 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:31.746145 (+ 473us) log.cc:842] Serialized 26 byte log entry
0807 15:10:32.212601 (+466456us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b1800324760. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e7e345 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e9be22 00007f94dba455bb 00007f94dba4b063 00007f94dba4b411 00007f94dbd985cf
0807 15:10:32.602947 (+390346us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:10:32.603001 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:32.603092 (+ 91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:32.797723 (+194631us) raft_consensus.cc:1671] finished
0807 15:10:32.797748 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:32.798022 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":991,"raft.queue_time_us":329,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":5368,"spinlock_wait_cycles":9357056,"thread_start_us":389470,"threads_started":1,"wal-append.queue_time_us":909887}
W20260807 15:10:32.812464 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 130695us
I20260807 15:10:32.794740 29569 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:10:32.840086 32229 log.cc:924] Time spent T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.077s user 0.000s sys 0.001s
I20260807 15:10:32.841711 32207 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:32.842319 32207 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:32.842487 32213 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:32.850215 32207 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:32.846683 29449 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:32.854801 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:32.855481 29483 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:32.760685 32201 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:32.871567 29609 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:32.909497 32105 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:32.910008 32105 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:32.909865 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:32.910398 32105 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:32.930635 32226 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:10:32.942343 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 62594.7us
W20260807 15:10:32.944903 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 64057.6us
I20260807 15:10:33.034984 32213 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:33.041215 32191 log.cc:924] Time spent T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.056s user 0.000s sys 0.001s
I20260807 15:10:33.041917 32152 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:31.883095 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:33.079643 29379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 371) took 1855 ms. Trace:
I20260807 15:10:33.107429 32105 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:33.119467 32231 log.cc:924] Time spent T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.152s user 0.000s sys 0.001s
I20260807 15:10:33.123674 32105 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:33.093293 29379 rpcz_store.cc:276] 0807 15:10:31.224040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:31.244658 (+ 20618us) service_pool.cc:227] Handling call
0807 15:10:33.079539 (+1834881us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:31.461875 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:31.538318 (+ 76443us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:31.538412 (+ 94us) write_op.cc:435] Acquired schema lock
0807 15:10:31.538428 (+ 16us) tablet.cc:660] Decoding operations
0807 15:10:31.552460 (+ 14032us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:31.560270 (+ 7810us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:31.560302 (+ 32us) tablet.cc:683] Acquiring locks for 5 operations
0807 15:10:31.560937 (+ 635us) tablet.cc:699] Row locks acquired
0807 15:10:31.560955 (+ 18us) write_op.cc:260] PREPARE: finished
0807 15:10:31.561096 (+ 141us) write_op.cc:270] Start()
0807 15:10:31.561206 (+ 110us) write_op.cc:276] Timestamp: P: 1786115431561046 usec, L: 0
0807 15:10:31.561228 (+ 22us) op_driver.cc:331] REPLICATION: starting
0807 15:10:31.565973 (+ 4745us) log.cc:842] Serialized 2217 byte log entry
0807 15:10:31.785937 (+219964us) op_driver.cc:444] REPLICATION: finished
0807 15:10:31.792994 (+ 7057us) write_op.cc:301] APPLY: starting
0807 15:10:31.793097 (+ 103us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:31.793347 (+ 250us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:31.793474 (+ 127us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:31.794358 (+ 884us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:31.794627 (+ 269us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0807 15:10:31.794698 (+ 71us) write_op.cc:312] APPLY: finished
0807 15:10:31.795032 (+ 334us) log.cc:842] Serialized 47 byte log entry
0807 15:10:31.795210 (+ 178us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:31.795353 (+ 143us) write_op.cc:454] Released schema lock
0807 15:10:31.795408 (+ 55us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:31.845687 (+ 50279us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:31.849259 (+ 3572us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":163436,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":6799,"apply.run_cpu_time_us":3270,"apply.run_wall_time_us":65874,"num_ops":5,"prepare.queue_time_us":53604,"prepare.run_cpu_time_us":5959,"prepare.run_wall_time_us":104497,"replication_time_us":224609,"thread_start_us":49329,"threads_started":1}]]}
I20260807 15:10:33.260250 32225 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:33.263510 32051 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:33.261524 32225 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:33.330945 32225 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:33.331441 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:33.275645 32128 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:33.332819 32016 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:33.347398 32016 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:33.348724 32051 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:33.352453 32016 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:33.352595 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:33.353557 29480 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:33.354794 32016 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:33.355413 29533 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:33.355751 32016 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:33.358753 32163 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:33.360311 32016 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:33.362154 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:33.365296 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:33.367640 30306 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s user 0.027s sys 0.050s
W20260807 15:10:33.368165 30306 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s user 0.028s sys 0.050s
I20260807 15:10:33.371481 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:33.359427 32163 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:33.370555 32125 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:33.377326 32225 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:33.347352 32128 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:33.391243 30309 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.761s user 0.024s sys 0.087s
I20260807 15:10:33.381644 32163 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:10:33.391762 30309 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.762s user 0.024s sys 0.087s
W20260807 15:10:33.392004 30312 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.757s user 0.036s sys 0.079s
W20260807 15:10:33.392765 30312 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.758s user 0.036s sys 0.080s
I20260807 15:10:33.395538 30309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 667) took 1003 ms. Trace:
I20260807 15:10:33.413406 32128 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:33.417114 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:33.400344 30309 rpcz_store.cc:276] 0807 15:10:32.392563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:32.393436 (+ 873us) service_pool.cc:227] Handling call
0807 15:10:32.393684 (+ 248us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:32.393870 (+ 186us) raft_consensus.cc:1520] Early marking committed up to index 7
0807 15:10:32.627516 (+233646us) log.cc:842] Serialized 14 byte log entry
0807 15:10:33.392254 (+764738us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:33.392332 (+ 78us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:10:33.392400 (+ 68us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:33.395337 (+ 2937us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:33.395479 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4264,"prepare.queue_time_us":267887,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":25827,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3097,"thread_start_us":983868,"threads_started":2}
I20260807 15:10:33.425925 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:33.429581 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:33.406039 32051 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:33.423629 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:33.440081 32128 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:10:33.449839 32080 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s user 0.024s sys 0.030s
W20260807 15:10:33.496361 32080 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s user 0.024s sys 0.030s
I20260807 15:10:33.527009 32128 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:33.551944 29609 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.620s user 0.012s sys 0.032s
W20260807 15:10:33.552446 29609 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.621s user 0.012s sys 0.032s
W20260807 15:10:33.548357 32178 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s user 0.019s sys 0.049s
W20260807 15:10:33.567610 32178 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s user 0.020s sys 0.050s
W20260807 15:10:33.568646 29563 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s user 0.010s sys 0.047s
W20260807 15:10:33.569128 29563 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s user 0.010s sys 0.047s
W20260807 15:10:33.569851 30274 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.602s user 0.001s sys 0.027s
W20260807 15:10:33.570305 30274 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.607s user 0.001s sys 0.027s
W20260807 15:10:33.570853 29608 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.627s user 0.000s sys 0.024s
W20260807 15:10:33.571244 29608 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.627s user 0.000s sys 0.024s
I20260807 15:10:33.578842 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:33.583348 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:33.584390 29481 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:33.599138 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:33.599911 29566 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:10:33.598727 29365 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 1177fe2445db43e2b8366f33a841a041 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 4b092f7f951b4137b5d7810056684270 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:33.551062 32128 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:33.605412 29365 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 45428.3us
I20260807 15:10:33.607118 29481 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
W20260807 15:10:33.611856 29607 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.668s user 0.016s sys 0.035s
W20260807 15:10:33.612042 30273 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.637s user 0.009s sys 0.066s
W20260807 15:10:33.612284 29607 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.668s user 0.016s sys 0.035s
W20260807 15:10:33.612571 30273 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.637s user 0.009s sys 0.066s
I20260807 15:10:33.598727 32029 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:33.595485 30310 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s user 0.010s sys 0.015s
W20260807 15:10:33.633610 30310 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s user 0.011s sys 0.015s
W20260807 15:10:33.636497 29452 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.692s user 0.000s sys 0.018s
W20260807 15:10:33.637933 29452 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.693s user 0.000s sys 0.019s
W20260807 15:10:33.649197 29450 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.690s user 0.011s sys 0.009s
W20260807 15:10:33.654842 29450 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.696s user 0.011s sys 0.009s
W20260807 15:10:33.652221 29449 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.719s user 0.000s sys 0.019s
W20260807 15:10:33.659397 29449 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.731s user 0.000s sys 0.019s
I20260807 15:10:33.663103 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:33.663932 30311 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:10:33.659862 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 770387us
I20260807 15:10:33.614003 32143 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:10:33.631359 31887 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s user 0.004s sys 0.018s
I20260807 15:10:33.611605 32225 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:33.679714 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:33.650923 32210 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:33.651335 32219 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:33.681969 31887 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s user 0.005s sys 0.018s
I20260807 15:10:33.689196 32200 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:33.706921 32200 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:33.688928 32225 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:33.710315 32225 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:33.736573 29479 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s user 0.021s sys 0.020s
W20260807 15:10:33.737114 29479 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s user 0.022s sys 0.021s
W20260807 15:10:33.737524 32241 log.cc:924] Time spent T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
W20260807 15:10:33.738853 32239 log.cc:924] Time spent T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
I20260807 15:10:33.643034 32029 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:33.878340 32243 log.cc:924] Time spent T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260807 15:10:33.729847 32201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46792 (request call id 1056) took 2476 ms. Trace:
I20260807 15:10:33.903530 30310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 547) took 1124 ms. Trace:
I20260807 15:10:33.904670 32128 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:33.738793 32200 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:33.904103 30310 rpcz_store.cc:276] 0807 15:10:32.778738 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:32.778920 (+ 182us) service_pool.cc:227] Handling call
0807 15:10:32.779627 (+ 707us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:32.795817 (+ 16190us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:32.795850 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:32.800912 (+ 5062us) log.cc:842] Serialized 508 byte log entry
0807 15:10:33.634241 (+833329us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:33.634318 (+ 77us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:33.634425 (+ 107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:33.903211 (+268786us) raft_consensus.cc:1671] finished
0807 15:10:33.903232 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:33.903392 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":776500,"threads_started":1,"wal-append.queue_time_us":1088676}
I20260807 15:10:33.903970 32201 rpcz_store.cc:276] 0807 15:10:31.205438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:31.230716 (+ 25278us) service_pool.cc:227] Handling call
0807 15:10:31.266942 (+ 36226us) log.cc:842] Serialized 508 byte log entry
0807 15:10:31.454251 (+187309us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18001b7a20. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e134ca 00007f94e24f4f99 00007f94d8cd7990 00007f94d8e99864 00007f94d8e99155 00007f94dbd3e320 00007f94dbda4113 00007f94dbdca7e2 00007f94dbdc2c1a
0807 15:10:33.671229 (+2216978us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":89341,"raft.queue_time_us":110653,"raft.run_cpu_time_us":5003,"raft.run_wall_time_us":77743,"spinlock_wait_cycles":25595264,"thread_start_us":76447,"threads_started":1,"wal-append.queue_time_us":71783,"wal-append.run_cpu_time_us":4370,"wal-append.run_wall_time_us":1100360}
I20260807 15:10:33.685426 32143 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:33.934396 30311 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:33.900434 32029 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:33.941049 30306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 665) took 1564 ms. Trace:
I20260807 15:10:33.944739 30306 rpcz_store.cc:276] 0807 15:10:32.376452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:32.379803 (+ 3351us) service_pool.cc:227] Handling call
0807 15:10:32.388028 (+ 8225us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:32.485286 (+ 97258us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:32.485331 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:32.486658 (+ 1327us) log.cc:842] Serialized 508 byte log entry
0807 15:10:33.368601 (+881943us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:33.368657 (+ 56us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:33.395485 (+ 26828us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b54006bdfd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:33.395533 (+ 48us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:33.940665 (+545132us) raft_consensus.cc:1671] finished
0807 15:10:33.940692 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:33.940963 (+ 271us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":222267136,"thread_start_us":881375,"threads_started":1,"wal-append.queue_time_us":1114116}
I20260807 15:10:33.943228 32143 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:33.761843 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:33.943578 32163 consensus_meta.cc:287] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.537s user 0.007s sys 0.008s
I20260807 15:10:33.970723 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:33.713872 32210 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:33.732926 32219 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:33.996554 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:33.996860 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:33.997700 30309 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:34.021663 32054 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.022406 32054 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:33.997835 32222 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.015168 32080 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:34.023499 32178 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:34.029500 32143 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:34.024379 32016 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:34.041548 29380 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.955s user 0.022s sys 0.046s
I20260807 15:10:33.973376 32163 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.022853 32235 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:10:34.049844 29380 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.963s user 0.023s sys 0.046s
I20260807 15:10:34.068234 29570 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:34.074388 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 673) took 1297 ms. Trace:
W20260807 15:10:34.084020 29640 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.157s user 0.011s sys 0.030s
W20260807 15:10:34.084476 29640 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s user 0.011s sys 0.030s
W20260807 15:10:34.085160 30272 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.095s user 0.008s sys 0.036s
W20260807 15:10:34.086993 30272 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.097s user 0.008s sys 0.036s
I20260807 15:10:34.058211 32065 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:34.074985 29563 rpcz_store.cc:276] 0807 15:10:32.777458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:32.781555 (+ 4097us) service_pool.cc:227] Handling call
0807 15:10:32.781924 (+ 369us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:32.804702 (+ 22778us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:32.804729 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:32.805242 (+ 513us) log.cc:842] Serialized 26 byte log entry
0807 15:10:33.569653 (+764411us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:10:33.610818 (+ 41165us) log.cc:842] Serialized 14 byte log entry
0807 15:10:33.635661 (+ 24843us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:33.635737 (+ 76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:34.074054 (+438317us) raft_consensus.cc:1671] finished
0807 15:10:34.074085 (+ 31us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:34.074300 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22327,"prepare.queue_time_us":44568,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":25842,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":28460,"thread_start_us":763993,"threads_started":1,"wal-append.queue_time_us":1084823}
I20260807 15:10:34.042762 32222 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.045210 32080 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.108949 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.110368 32080 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:34.104455 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.063916 32219 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.046203 32143 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.052448 32016 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.054446 32178 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.059293 32235 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:34.131625 29566 consensus_meta.cc:287] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.531s user 0.011s sys 0.004s
I20260807 15:10:34.133610 29566 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:10:34.131307 29561 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s user 0.010s sys 0.001s
W20260807 15:10:34.134510 29561 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.520s user 0.011s sys 0.002s
I20260807 15:10:34.140610 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.147069 32143 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:34.147571 32235 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.149680 32222 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.150233 32163 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.122706 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.130463 32054 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.154986 29570 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:34.155966 32210 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.157085 32210 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.157296 32178 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:34.157905 32016 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.157830 32210 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.163193 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.163748 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.160030 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2036) took 1315 ms. Trace:
I20260807 15:10:34.120009 32249 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:34.107538 32065 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.183036 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.177062 30309 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:34.142349 32212 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.164928 32163 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.169663 32016 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.173306 32222 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.167243 29479 rpcz_store.cc:276] 0807 15:10:32.844599 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:32.845035 (+ 436us) service_pool.cc:227] Handling call
0807 15:10:32.878805 (+ 33770us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:32.932350 (+ 53545us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:32.932381 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:32.967294 (+ 34913us) log.cc:842] Serialized 26 byte log entry
0807 15:10:33.737499 (+770205us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:33.737538 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:34.090217 (+352679us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b54001829d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:34.090328 (+ 111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:34.158494 (+ 68166us) raft_consensus.cc:1671] finished
0807 15:10:34.158521 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:34.159952 (+ 1431us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":619,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":20580,"spinlock_wait_cycles":122307456,"thread_start_us":711696,"threads_started":1,"wal-append.queue_time_us":1141822}
I20260807 15:10:34.195847 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.196285 32212 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:34.216329 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 482609us
I20260807 15:10:34.178099 32249 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.202324 32163 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.231277 29609 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:34.203311 32222 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.203101 32016 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.244935 29640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59992 (request call id 2227) took 1386 ms. Trace:
I20260807 15:10:34.188187 32251 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.245769 29365 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 748d0394657643cfbf71e2bac60ff2f2 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:34.245355 29640 rpcz_store.cc:276] 0807 15:10:32.858192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:32.858324 (+ 132us) service_pool.cc:227] Handling call
0807 15:10:32.858830 (+ 506us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:32.859298 (+ 468us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:32.859334 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:32.876720 (+ 17386us) log.cc:842] Serialized 508 byte log entry
0807 15:10:34.084882 (+1208162us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:34.084937 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:34.085030 (+ 93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:34.244708 (+159678us) raft_consensus.cc:1671] finished
0807 15:10:34.244730 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:34.244876 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1157512,"threads_started":1,"wal-append.queue_time_us":1311544}
I20260807 15:10:34.244745 32105 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:34.268579 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:34.270234 29608 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.520s user 0.005s sys 0.015s
W20260807 15:10:34.272562 29608 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.522s user 0.006s sys 0.015s
I20260807 15:10:34.275866 32051 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.276551 32051 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.277377 32128 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.277977 32128 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.279017 32051 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:34.281849 30274 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s user 0.034s sys 0.053s
W20260807 15:10:34.282230 30274 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.591s user 0.034s sys 0.053s
I20260807 15:10:34.284534 29640 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:34.285390 29640 raft_consensus.cc:595] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:34.268885 32210 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.274621 32105 raft_consensus.cc:686] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:10:34.300534 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 325993us
I20260807 15:10:34.307952 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.264444 32251 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:34.303350 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 109683us
I20260807 15:10:34.285567 32257 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.347175 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.348001 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.294078 32189 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.350149 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.288800 32029 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.352532 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.355386 32105 consensus_queue.cc:237] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.355681 32249 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.356576 32251 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:34.357407 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.358167 32249 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.358732 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.358793 32249 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.353072 32178 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.360441 32178 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.352550 32160 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.361351 32249 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.361631 32160 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.362435 32178 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.362972 32178 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:34.300069 32071 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.362690 32257 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.363471 30272 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:34.363734 32071 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.365345 32257 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.365906 32257 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:34.366067 32071 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.299795 32035 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.300467 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.355630 32029 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.371094 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.380524 29570 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:34.372586 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.352052 32225 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.381090 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:34.381665 32225 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.383857 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.385013 32225 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.385553 32225 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.385725 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.373203 32178 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.386204 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.386611 29646 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:34.388005 32178 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.388443 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.389155 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.389832 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.390208 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.353457 32128 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.400543 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.245325 31887 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:34.379536 32206 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.413614 32253 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.394680 32234 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.390821 32035 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.446363 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:34.397516 32225 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.400857 30273 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:34.426940 29609 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:34.412055 32065 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.373265 32189 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:34.449977 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 49210us
I20260807 15:10:34.418391 32128 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:34.458415 29479 raft_consensus.cc:2354] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3.
I20260807 15:10:34.461614 30273 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:34.425084 32271 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:34.464118 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.465413 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.439440 32222 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:34.470935 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 165458us
I20260807 15:10:34.450454 32212 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.476830 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.458137 32257 raft_consensus.cc:2781] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:34.455273 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.458585 32210 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:34.468538 32158 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:34.486806 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.474494 32163 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.465230 32125 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.478271 32135 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:34.472055 32160 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:34.482641 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 184424us
W20260807 15:10:34.490020 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 189356us
I20260807 15:10:34.500809 29449 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:34.519596 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.519635 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.521283 29480 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:34.521340 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.482110 32257 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.527189 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.437220 32206 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.468338 32128 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.449003 32253 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.556486 32128 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.558364 32189 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.558651 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.559697 32206 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.530359 32135 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:34.560998 32016 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.561268 32135 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.563915 32279 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:34.487618 32210 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.451808 32234 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.566185 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:34.566366 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 98744.2us
I20260807 15:10:34.567361 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:34.570271 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 93609.9us
I20260807 15:10:34.574007 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.574734 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.574867 30273 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:34.575143 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.574766 29480 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:34.585521 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.467983 32271 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.532218 32257 raft_consensus.cc:3037] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:34.600015 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.604956 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.608026 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.610486 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:34.615051 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 114387us
W20260807 15:10:34.616807 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 89804.5us
I20260807 15:10:34.609009 29479 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
W20260807 15:10:34.621899 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 105450us
W20260807 15:10:34.622839 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 98423.4us
I20260807 15:10:34.626776 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.627689 29570 raft_consensus.cc:2379] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:34.583717 32212 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:34.631389 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.632134 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.586403 32265 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:34.638768 29531 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:34.525998 32125 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:34.643011 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 63401us
I20260807 15:10:34.652529 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.649221 30306 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:34.653923 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.654860 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:34.655357 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.595109 32210 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.599033 32029 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.662417 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:34.667976 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.670248 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:34.674037 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 63952.1us
I20260807 15:10:34.669037 30312 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:34.677043 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.639360 32251 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:34.643975 32225 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.684194 29452 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:34.685262 29647 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:34.687580 29647 raft_consensus.cc:595] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:34.652395 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.659157 32016 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:34.663740 32222 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:34.692299 29452 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:34.663558 32248 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:34.652791 32265 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.705179 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:34.692636 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 68194.8us
I20260807 15:10:34.679381 32267 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:34.741328 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 49122.2us
I20260807 15:10:34.680929 32189 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:34.748240 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 85817.9us
I20260807 15:10:34.692751 32225 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:34.756407 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:34.723337 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.701447 32234 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.764132 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.745599 32267 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.776521 32265 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:34.760402 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.762044 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.779438 29638 raft_consensus.cc:1799] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Handling vote request from an unknown peer 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:34.765440 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.766333 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.773192 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.773873 32125 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.775058 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:34.778775 29452 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:34.783326 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:34.785243 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 204783us
I20260807 15:10:34.780251 29644 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:34.786125 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:34.786895 29570 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:34.686751 32251 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.788785 29608 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:34.789132 29640 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:34.789795 29640 raft_consensus.cc:595] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:34.793949 29638 raft_consensus.cc:2396] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260807 15:10:34.791219 29533 leader_election.cc:398] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3.
I20260807 15:10:34.798987 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.799908 32267 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.795603 29533 leader_election.cc:401] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260807 15:10:34.801020 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 45623.4us
I20260807 15:10:34.741433 32248 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:34.822822 30272 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:34.758599 32289 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:34.829487 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.829980 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.753587 32189 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:34.834249 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.802897 32135 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:34.798204 32225 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:34.806653 32291 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:34.860627 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 69622.6us
I20260807 15:10:34.866032 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.869824 29488 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:10:34.869868 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:34.832854 32253 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.876633 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.882273 30311 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
W20260807 15:10:34.880496 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 87868.8us
I20260807 15:10:34.860191 32212 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:34.878052 29483 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:34.879104 29533 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:34.862046 32051 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3.
I20260807 15:10:34.866683 32135 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:34.885494 29449 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:34.891472 32189 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:34.894649 32135 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:34.899051 32248 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.872067 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.877383 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:34.872267 32305 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:34.881561 32225 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:10:35.023770 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 245102us
W20260807 15:10:35.080128 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 172379us
I20260807 15:10:35.083844 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:35.085688 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.090242 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:34.910539 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:35.094090 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 183679us
W20260807 15:10:34.909899 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 78262us
I20260807 15:10:35.095148 29533 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:34.889067 32271 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:34.905614 32267 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:35.099612 32270 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.081563 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.113879 29609 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:34.955627 32282 log.cc:924] Time spent T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.249s user 0.001s sys 0.000s
I20260807 15:10:35.116823 29609 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:34.956221 32189 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:35.119611 30274 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:34.956120 32295 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:35.077003 32251 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:35.126796 29488 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:35.121836 29533 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:35.138607 29488 raft_consensus.cc:595] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
W20260807 15:10:35.134172 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 487629us
I20260807 15:10:35.129912 30274 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.140419 30274 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.141568 29531 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:34.887512 32291 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.149422 32291 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:35.123641 32273 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:35.156389 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 334036us
I20260807 15:10:35.123270 32071 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:35.130821 32207 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:35.129252 32271 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:35.164435 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:35.126346 32189 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.134666 32295 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.140039 32290 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:35.173705 29609 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.162747 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:35.146814 32225 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:35.177919 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:35.160544 29531 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.145816 32303 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:35.151397 32212 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:35.157922 32251 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:35.125644 32267 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:35.185933 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:35.187440 29609 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.216202 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.180148 32189 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:35.217813 32204 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:10:35.214282 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:35.307421 32301 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:35.175159 32283 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.168507 32271 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:35.220675 31887 consensus_meta.cc:287] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.745s user 0.014s sys 0.000s
I20260807 15:10:35.188954 32278 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.188618 32214 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:35.131003 32270 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:35.168951 32296 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:35.181610 32295 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:35.224548 32160 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:10:35.214363 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 53906.7us
I20260807 15:10:35.243503 29560 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 15:10:35.215730 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.320542 32294 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.231652 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:35.294056 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 106688us
I20260807 15:10:35.295749 32251 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.296682 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.347357 29609 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.303970 32281 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:35.297008 32257 consensus_meta.cc:287] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.655s user 0.012s sys 0.000s
I20260807 15:10:35.347991 29531 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.291651 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.185312 32225 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.305979 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.309262 29533 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:35.223635 32135 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:35.317328 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.305497 32305 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:35.357075 32316 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260807 15:10:35.306344 32212 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.307971 32301 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.297398 32312 raft_consensus.cc:979] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:35.349040 32294 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.352159 32273 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:35.343963 32235 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:35.345911 32125 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.352187 32251 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.418316 32125 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.420269 32294 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.420693 32251 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.351555 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.361138 30274 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:35.421828 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 70358.8us
I20260807 15:10:35.422077 32300 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.422871 29531 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.422760 32300 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.362519 29449 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:35.364069 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 54210us
I20260807 15:10:35.424733 32016 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:35.317145 32267 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.425043 29531 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:35.384123 29365 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 1177fe2445db43e2b8366f33a841a041 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 4b092f7f951b4137b5d7810056684270 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:35.426520 32308 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:10:35.410530 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 50314.5us
I20260807 15:10:35.426988 32235 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.428673 32160 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:35.429345 32235 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.354295 32225 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:35.456918 32280 log.cc:924] Time spent T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.834s user 0.003s sys 0.005s
I20260807 15:10:35.457653 32267 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:35.425120 32016 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.460475 32016 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:35.460855 32161 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:35.439330 32065 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.461426 32161 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.461731 32065 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
W20260807 15:10:35.464643 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 103649us
I20260807 15:10:35.465018 32300 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:35.465553 31887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52540 (request call id 835) took 3881 ms. Trace:
I20260807 15:10:35.467521 30272 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.386068 32207 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:35.432121 32266 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:35.432955 32135 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:35.434180 32303 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.374212 32301 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:35.354005 32257 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.329486 32271 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:35.447619 32297 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.447866 32125 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.449373 32189 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:35.452244 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 89818.6us
I20260807 15:10:35.357671 32305 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.491307 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:35.471148 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:35.384137 32212 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.494656 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:35.473032 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 48274.1us
W20260807 15:10:35.495765 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 70796us
I20260807 15:10:35.465981 31887 rpcz_store.cc:276] 0807 15:10:31.577851 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:31.577969 (+ 118us) service_pool.cc:227] Handling call
0807 15:10:31.718985 (+141016us) log.cc:842] Serialized 508 byte log entry
0807 15:10:32.380419 (+661434us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b180008faa0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:10:32.425407 (+ 44988us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b180008faa0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c764 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:10:32.466142 (+ 40735us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b180008faa0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e69f96 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11
0807 15:10:32.731609 (+265467us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b5800021bb0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbd3e834 00007f94dbd43771 00007f94dbd436f9 00007f94dbd43689 00007f94dbd43651 00007f94dbd4281d 00007f94e2100204 00007f94e2100039 00007f94d8e9c6b6 00007f94d8e9fb11
0807 15:10:35.417504 (+2685895us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":34715,"raft.queue_time_us":7340,"raft.run_cpu_time_us":5026,"raft.run_wall_time_us":364367,"spinlock_wait_cycles":434738176,"thread_start_us":31602,"threads_started":1,"wal-append.queue_time_us":48652,"wal-append.run_cpu_time_us":6970,"wal-append.run_wall_time_us":1212162}
I20260807 15:10:35.479432 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.479882 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.480662 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.496717 29644 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:35.475767 32161 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:35.414752 29485 raft_consensus.cc:1261] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:10:35.439252 32312 raft_consensus.cc:1067] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:35.320247 32283 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.323480 32278 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:35.488674 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:35.491955 29566 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:35.472465 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 46302.6us
I20260807 15:10:35.496707 29531 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.480971 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.504418 30309 raft_consensus.cc:1226] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:35.497617 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.494728 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.477371 32270 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.486275 32065 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:35.511590 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.492247 32294 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:35.518170 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.516642 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.516964 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.501588 32248 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:35.487311 32324 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:35.569317 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.373796 32281 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:35.523160 29643 raft_consensus.cc:2932] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:35.577095 29645 raft_consensus.cc:2379] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 3: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:35.599263 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:35.604276 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 91891.4us
I20260807 15:10:35.605602 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.600522 29480 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:35.607841 32332 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:35.608863 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.609647 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.610205 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.611819 29366 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 3518672558d94e27a30f3efea0bbeab6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 15:10:35.611958 32332 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.608714 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.613364 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:35.605602 29450 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.569058 32248 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.655051 29565 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:35.560825 32294 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.655081 29449 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.613257 32287 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:35.662122 32325 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:35.500490 32266 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.662405 32330 consensus_queue.cc:1035] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260807 15:10:35.485519 32303 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.508811 32297 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.679141 32287 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:35.683071 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 77537.4us
I20260807 15:10:35.684216 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:35.692865 29450 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.612664 32332 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.700142 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:35.702759 29638 raft_consensus.cc:2354] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3.
I20260807 15:10:35.703378 29450 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:35.662390 32328 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:35.688346 32301 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.709069 32333 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:35.710048 32333 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:35.710752 32301 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:35.702346 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 197279us
I20260807 15:10:35.712280 29641 raft_consensus.cc:1226] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:35.708292 32323 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:10:35.712656 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 230603us
I20260807 15:10:35.713201 32333 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:35.705889 32257 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:35.682287 32287 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:35.693259 32035 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.731252 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.733590 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:35.732488 32305 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:35.695935 32065 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:35.699951 32189 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.737104 29531 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:35.741091 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.745942 29566 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:35.750466 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:35.751758 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 44188.8us
I20260807 15:10:35.751979 32297 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:35.752766 32273 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:35.757649 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.760139 30272 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.761996 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.762616 29564 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:35.767782 30273 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:35.768922 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.721578 32283 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.773526 30272 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:35.777801 30272 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:35.779294 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.779321 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:35.784375 30272 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:35.707507 32225 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:35.751794 32016 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:35.789263 32322 log.cc:924] Time spent T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.268s user 0.000s sys 0.001s
I20260807 15:10:35.786329 32035 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:35.790239 32035 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.790722 32035 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:35.765686 32212 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:35.803263 30272 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:35.804574 32309 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:35.804783 32257 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:35.807996 32257 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:35.811440 29640 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:35.812253 32335 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:35.812902 32335 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:35.813479 32335 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:35.812263 29640 raft_consensus.cc:595] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:35.829315 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:35.832302 32246 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:35.785446 32283 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:35.835251 29560 raft_consensus.cc:1226] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:35.833140 32246 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.784482 32278 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.844257 30272 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:35.863518 32266 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:35.835181 32294 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.867201 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:35.869226 32245 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:35.869832 32245 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:35.872053 32245 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:35.873175 32204 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:35.873778 32204 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:10:35.873943 32016 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.860002 32283 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:35.885690 29533 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:35.885865 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:35.875427 32281 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
W20260807 15:10:35.891964 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 332829us
I20260807 15:10:35.883752 32248 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:35.901230 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:35.906113 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:35.906386 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:35.906790 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2530) took 1269 ms. Trace:
I20260807 15:10:35.888870 32128 raft_consensus.cc:2741] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 15:10:35.907047 29487 rpcz_store.cc:276] 0807 15:10:34.636980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:34.638135 (+ 1155us) service_pool.cc:227] Handling call
0807 15:10:35.905976 (+1267841us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b5800001898. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:35.906743 (+ 767us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16246016}
I20260807 15:10:35.935634 32310 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:35.936431 32310 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:35.940385 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:35.905180 32279 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:35.973968 29645 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46792
I20260807 15:10:35.974861 29645 raft_consensus.cc:595] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Received request to transfer leadership
I20260807 15:10:35.978948 32035 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:35.996840 30309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1001) took 1314 ms. Trace:
I20260807 15:10:35.997370 30309 rpcz_store.cc:276] 0807 15:10:34.682832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:34.689725 (+ 6893us) service_pool.cc:227] Handling call
0807 15:10:34.690089 (+ 364us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:35.504914 (+814825us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:35.996529 (+491615us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54005f37d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:35.996766 (+ 237us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1872251776}
I20260807 15:10:35.998951 32035 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.962525 32332 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.013583 32303 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:35.992807 32225 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:36.026726 32295 consensus_meta.cc:287] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.671s user 0.010s sys 0.000s
I20260807 15:10:36.055496 32265 raft_consensus.cc:979] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:36.056320 32265 raft_consensus.cc:1067] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:35.975703 32279 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.027868 32295 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.315667 29560 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
W20260807 15:10:36.058123 29483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2529) took 1421 ms (client timeout 1536 ms). Trace:
I20260807 15:10:36.280658 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:36.222112 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:36.314307 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 611577us
I20260807 15:10:36.151283 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:36.322571 29567 raft_consensus.cc:1261] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:10:36.323683 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:36.322402 29488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 574) took 1144 ms. Trace:
I20260807 15:10:36.324013 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:36.326391 29481 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:36.322826 29450 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:36.327520 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:35.939756 32310 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.327463 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:36.320027 29560 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:36.330742 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:36.334771 29560 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:36.334877 30306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48588 (request call id 686) took 1490 ms (client timeout 1871 ms). Trace:
I20260807 15:10:36.331039 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:36.332273 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260807 15:10:36.320734 29483 rpcz_store.cc:269] 0807 15:10:34.636679 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:34.637839 (+ 1160us) service_pool.cc:227] Handling call
0807 15:10:34.704977 (+ 67138us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b5800001898. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:36.057900 (+1352923us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001829d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:36.058055 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":384557056}
W20260807 15:10:36.335513 30306 rpcz_store.cc:269] 0807 15:10:34.834435 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:34.866207 (+ 31772us) service_pool.cc:227] Handling call
0807 15:10:36.151090 (+1284883us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b5800005198. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:36.325045 (+173955us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4116352}
I20260807 15:10:36.336275 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:36.336845 29483 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:36.333809 29450 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:36.337373 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:36.340592 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:36.341094 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:36.178592 32290 raft_consensus.cc:979] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:36.343114 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:36.343560 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:36.344668 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:36.325937 29488 rpcz_store.cc:276] 0807 15:10:35.178031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:35.178169 (+ 138us) service_pool.cc:227] Handling call
0807 15:10:36.221889 (+1043720us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5800001898. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:36.322338 (+100449us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4444928}
I20260807 15:10:36.345378 32272 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:36.345873 32272 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.346369 32272 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:36.348529 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:36.340016 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:36.339365 32161 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.351017 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:36.354256 29567 raft_consensus.cc:2354] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3.
I20260807 15:10:36.352886 29561 raft_consensus.cc:1226] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:36.059723 32246 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:36.152632 32271 consensus_meta.cc:287] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.651s user 0.012s sys 0.000s
I20260807 15:10:36.351542 29487 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:36.357771 29565 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:36.272519 32016 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:36.372437 32307 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 1.233s user 0.003s sys 0.040s
I20260807 15:10:36.376812 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:36.395305 29564 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:36.381451 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:36.383306 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:36.156385 32304 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.381232 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:36.406632 30274 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:36.390221 29450 leader_election.cc:398] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3.
I20260807 15:10:36.407400 29450 leader_election.cc:401] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 15:10:36.400039 32250 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.388978 30310 raft_consensus.cc:2932] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:36.401404 32314 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:36.402705 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2590) took 1480 ms. Trace:
I20260807 15:10:36.412565 29561 rpcz_store.cc:276] 0807 15:10:34.922061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:34.923814 (+ 1753us) service_pool.cc:227] Handling call
0807 15:10:34.924236 (+ 422us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:36.368822 (+1444586us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:36.402380 (+ 33558us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400319cd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:36.402622 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3285224832}
W20260807 15:10:36.385896 29609 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.193:39125 timed out after 1.536s (SENT) [suppressed 1 similar messages]
I20260807 15:10:36.411198 31887 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:36.420138 31887 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.424194 30304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 692) took 1043 ms. Trace:
I20260807 15:10:36.059413 32287 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.433959 31887 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.434015 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:36.395188 32290 raft_consensus.cc:1067] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:36.444865 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:36.453070 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:36.424912 30304 rpcz_store.cc:276] 0807 15:10:35.380683 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:35.384214 (+ 3531us) service_pool.cc:227] Handling call
0807 15:10:35.431065 (+ 46851us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:35.572190 (+141125us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:35.576532 (+ 4342us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:35.591403 (+ 14871us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:35.596464 (+ 5061us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:36.404362 (+807898us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540076f054. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:36.410774 (+ 6412us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:36.424091 (+ 13317us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":298430208}
W20260807 15:10:36.457101 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 142421us
I20260807 15:10:36.423697 32158 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:36.484301 32287 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:36.437791 32307 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 1.303s user 0.003s sys 0.040s
I20260807 15:10:36.471334 29563 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:36.480861 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:36.482610 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:36.411114 32270 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.488062 30272 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:36.489125 29484 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:36.425930 32288 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:36.490041 29484 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:36.490489 29484 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:36.490855 29487 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:36.491569 29486 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:36.486397 29560 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.493932 29566 raft_consensus.cc:1226] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:36.499459 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:36.500347 29488 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:36.499174 29533 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:36.503031 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:36.504725 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:36.505375 29645 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:36.504112 29560 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.524055 29645 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:36.396194 32271 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.532682 30272 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:36.405365 32016 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.391268 32161 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:36.501606 32335 consensus_meta.cc:287] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.687s user 0.014s sys 0.000s
I20260807 15:10:36.509277 32248 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:36.497433 30305 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260807 15:10:36.565732 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 66638.2us
I20260807 15:10:36.447131 32304 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.533671 32295 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.528977 32288 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.492312 32291 consensus_queue.cc:1046] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260807 15:10:36.599296 29449 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.895s user 0.034s sys 0.090s
W20260807 15:10:36.601019 29449 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.897s user 0.034s sys 0.090s
I20260807 15:10:36.594337 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:36.557509 32253 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:36.491614 32270 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.610128 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:36.611920 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:36.593683 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:36.614355 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:36.617442 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:36.617715 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:36.617849 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:36.618323 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:36.618534 29646 raft_consensus.cc:3032] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:36.622936 29642 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:36.619031 29646 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:36.633397 29608 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:36.583210 32287 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:36.633738 29646 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.647487 29646 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:36.653482 32312 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:36.653774 32163 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.600500 32288 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:36.485361 32250 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.488104 32246 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:36.660991 29449 leader_election.cc:398] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3.
I20260807 15:10:36.663064 32279 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:36.663594 32345 log.cc:924] Time spent T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.177s user 0.000s sys 0.001s
I20260807 15:10:36.667331 32271 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.670420 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:36.563238 32335 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.588735 32248 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.713544 29449 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:36.714021 29488 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:36.649029 32253 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:36.717064 30274 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:36.720682 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:36.720932 29533 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:36.671137 32287 raft_consensus.cc:686] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:36.668541 32266 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:36.716508 32204 consensus_meta.cc:287] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.838s user 0.014s sys 0.002s
W20260807 15:10:36.729280 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 196669us
I20260807 15:10:36.729786 30274 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:36.673584 32312 raft_consensus.cc:686] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:36.710986 32277 raft_consensus.cc:3032] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:36.688616 29483 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:36.741657 30312 raft_consensus.cc:2379] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:36.741097 32210 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:36.749081 29570 raft_consensus.cc:1226] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:36.757586 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2071) took 1610 ms. Trace:
I20260807 15:10:36.750159 29561 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:36.677315 32163 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.769351 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:36.733510 32283 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:10:36.777100 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:36.722293 32341 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:36.723994 32105 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:36.748997 32316 consensus_queue.cc:1046] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260807 15:10:36.752053 32343 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:36.800407 32287 consensus_queue.cc:237] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.801466 32312 consensus_queue.cc:237] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.757974 29479 rpcz_store.cc:276] 0807 15:10:35.146722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:35.146857 (+ 135us) service_pool.cc:227] Handling call
0807 15:10:36.058058 (+911201us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:36.058293 (+ 235us) raft_consensus.cc:1520] Early marking committed up to index 4
0807 15:10:36.342983 (+284690us) log.cc:842] Serialized 14 byte log entry
0807 15:10:36.635265 (+292282us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:36.635341 (+ 76us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:36.635402 (+ 61us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:36.635483 (+ 81us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:36.757462 (+121979us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54001829d0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:36.757537 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25496,"prepare.queue_time_us":343078,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":24730,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":5495,"spinlock_wait_cycles":2094962432,"thread_start_us":551335,"threads_started":2}
I20260807 15:10:36.715802 32289 consensus_queue.cc:1046] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260807 15:10:36.741204 32277 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:36.781394 32210 raft_consensus.cc:686] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:36.796535 32250 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.798017 32335 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:36.798381 32310 consensus_queue.cc:1046] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260807 15:10:36.799253 32341 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.752831 32266 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.838689 32341 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.840174 32266 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.742687 32204 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.841004 32278 raft_consensus.cc:3032] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:36.841747 32278 raft_consensus.cc:729] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:36.844444 29481 raft_consensus.cc:1226] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:10:36.711557 32246 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.794677 32344 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260807 15:10:36.800442 32105 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.749509 32329 consensus_queue.cc:1046] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260807 15:10:36.847400 32105 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:36.843536 32278 consensus_queue.cc:260] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.848230 32204 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.776794 32314 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:36.827256 29561 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:36.736459 32319 consensus_queue.cc:1035] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260807 15:10:36.749037 32338 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3.
I20260807 15:10:36.854396 29561 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:36.822649 32316 raft_consensus.cc:3032] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:36.782473 32347 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:36.796591 32304 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.811233 32248 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.849787 32016 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.855863 32266 raft_consensus.cc:3032] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
W20260807 15:10:36.886359 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 473575us
I20260807 15:10:36.861436 32316 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:36.896216 29484 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.901202 32342 raft_consensus.cc:3032] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:36.901714 32342 raft_consensus.cc:729] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:36.902575 32342 consensus_queue.cc:260] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.906972 30311 raft_consensus.cc:1226] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:36.907181 29484 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.876137 32270 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.913544 32158 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:36.890565 32161 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:36.872524 32347 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.891785 32212 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.932607 32212 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.935163 32212 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.913486 32257 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:36.936564 32257 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.824149 32277 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.854279 32253 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:36.943729 32163 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:36.944707 32277 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:36.924772 32349 log.cc:924] Time spent T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
W20260807 15:10:36.953650 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 567766us
I20260807 15:10:36.925714 32290 raft_consensus.cc:979] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:36.929662 32249 raft_consensus.cc:3032] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:36.920822 32210 consensus_queue.cc:237] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:36.954774 29609 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:36.889397 32266 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:36.890506 29450 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:10:36.993409 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 103018us
I20260807 15:10:36.994704 29450 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:36.976227 32319 raft_consensus.cc:1067] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:37.001277 29646 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:36.959398 32251 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:37.002002 29609 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:36.970016 32249 raft_consensus.cc:729] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:36.977381 32158 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:37.012737 32105 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:37.013679 32338 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:36.977523 32290 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.001402 32268 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:37.016711 29450 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.033499 29484 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:36.972822 32288 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
W20260807 15:10:37.019733 32272 consensus_meta.cc:287] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.670s user 0.013s sys 0.005s
I20260807 15:10:37.017781 32254 consensus_queue.cc:1046] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260807 15:10:37.020468 32342 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:37.019023 32338 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:37.028138 32246 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:37.050130 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.037926 29450 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.036515 32279 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:37.017918 32158 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.063496 32158 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:37.020957 32251 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.003863 32316 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.055918 32257 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:37.079514 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 355423us
I20260807 15:10:37.054069 32338 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:37.084492 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.074462 29482 raft_consensus.cc:1226] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:37.049377 32272 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:37.076200 32347 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:37.110101 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 315898us
I20260807 15:10:37.090819 32268 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.113622 29568 raft_consensus.cc:1226] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:37.082062 32330 consensus_queue.cc:1046] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260807 15:10:37.089975 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 52158.1us
I20260807 15:10:37.104782 32329 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:10:37.071116 32249 consensus_queue.cc:260] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:37.131539 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 377985us
I20260807 15:10:37.060434 32266 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.114666 32163 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:37.141608 29561 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.147149 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:37.148221 29568 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:37.126295 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.133885 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:37.134447 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 402208us
I20260807 15:10:37.155308 31887 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.115963 32254 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:37.158447 32254 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.129051 32329 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:37.127611 32290 consensus_queue.cc:1046] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260807 15:10:37.160481 32288 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:37.169459 32329 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.171068 32329 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:10:37.154218 32163 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.173700 32254 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:37.163450 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2552) took 1199 ms. Trace:
I20260807 15:10:37.174980 32163 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:37.168556 32251 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:37.165514 32249 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:37.174566 29482 rpcz_store.cc:276] 0807 15:10:35.963741 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:36.377920 (+414179us) service_pool.cc:227] Handling call
0807 15:10:36.426264 (+ 48344us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:37.101874 (+675610us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:37.144132 (+ 42258us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540018ecd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:37.159606 (+ 15474us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1441801088}
I20260807 15:10:37.186107 29568 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:37.188791 29531 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.190310 29531 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.193512 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.200233 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.201211 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.204752 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:37.204845 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.206821 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.208451 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.210984 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:37.211536 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.211594 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.212076 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.220880 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.213341 29531 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:37.224229 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 98153.6us
I20260807 15:10:37.214545 32296 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:37.213559 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:37.218776 32219 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 15:10:37.286728 32352 log.cc:924] Time spent T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.212s user 0.001s sys 0.000s
I20260807 15:10:37.286608 32246 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:37.219031 32161 consensus_queue.cc:1046] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260807 15:10:37.308372 29380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48690 (request call id 386) took 6023 ms. Trace:
I20260807 15:10:37.310411 29380 rpcz_store.cc:276] 0807 15:10:31.285304 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:31.286446 (+ 1142us) service_pool.cc:227] Handling call
0807 15:10:37.308216 (+6021770us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:34.226358 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:34.226952 (+ 594us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:34.226989 (+ 37us) write_op.cc:435] Acquired schema lock
0807 15:10:34.227007 (+ 18us) tablet.cc:660] Decoding operations
0807 15:10:34.227364 (+ 357us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:34.227427 (+ 63us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:34.227457 (+ 30us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:10:34.227675 (+ 218us) tablet.cc:699] Row locks acquired
0807 15:10:34.227718 (+ 43us) write_op.cc:260] PREPARE: finished
0807 15:10:34.227887 (+ 169us) write_op.cc:270] Start()
0807 15:10:34.228047 (+ 160us) write_op.cc:276] Timestamp: P: 1786115434227836 usec, L: 0
0807 15:10:34.228071 (+ 24us) op_driver.cc:331] REPLICATION: starting
0807 15:10:34.228900 (+ 829us) log.cc:842] Serialized 544 byte log entry
0807 15:10:35.077411 (+848511us) op_driver.cc:444] REPLICATION: finished
0807 15:10:35.979048 (+901637us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94d8e7e5fe 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e9be22 00007f94df7d4410
0807 15:10:36.652851 (+673803us) write_op.cc:301] APPLY: starting
0807 15:10:36.658548 (+ 5697us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:36.700203 (+ 41655us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:36.700224 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:36.729018 (+ 28794us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:36.753891 (+ 24873us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:10:36.777484 (+ 23593us) write_op.cc:312] APPLY: finished
0807 15:10:36.795651 (+ 18167us) log.cc:842] Serialized 23 byte log entry
0807 15:10:37.127927 (+332276us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:37.134815 (+ 6888us) write_op.cc:454] Released schema lock
0807 15:10:37.135438 (+ 623us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:37.177620 (+ 42182us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:37.177683 (+ 63us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":799997,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":1519940,"apply.run_cpu_time_us":25209,"apply.run_wall_time_us":536655,"num_ops":1,"prepare.queue_time_us":1133258,"prepare.run_cpu_time_us":13951,"prepare.run_wall_time_us":186677,"raft.queue_time_us":371719,"raft.run_cpu_time_us":45010,"raft.run_wall_time_us":1416105,"replication_time_us":848693,"spinlock_wait_cycles":10530688,"thread_start_us":3163423,"threads_started":5,"wal-append.queue_time_us":944399,"wal-append.run_cpu_time_us":49294,"wal-append.run_wall_time_us":1345129}]]}
I20260807 15:10:37.338428 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:37.308472 30304 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:37.213250 32363 consensus_queue.cc:1046] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260807 15:10:37.319370 32356 raft_consensus.cc:3032] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
W20260807 15:10:37.321547 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 95372.7us
W20260807 15:10:37.324497 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 198294us
W20260807 15:10:37.328577 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 115340us
I20260807 15:10:37.330015 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.331943 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.332245 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.333061 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.333297 29565 raft_consensus.cc:1226] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:37.333841 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.327406 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.335022 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.337641 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.337324 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.339623 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.342443 32272 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
W20260807 15:10:37.343499 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 57263.2us
I20260807 15:10:37.367466 30309 raft_consensus.cc:1226] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:37.367758 29609 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.344386 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.335695 32296 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:37.341595 32369 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:37.374063 32369 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.374552 32310 consensus_queue.cc:1046] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 15:10:37.344555 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 47092us
I20260807 15:10:37.346362 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.347263 32359 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:37.348929 32338 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.355726 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.366228 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.333531 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.375118 32143 raft_consensus.cc:979] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:37.376986 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:37.337707 32271 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.378468 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:37.391170 29567 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:37.391506 29646 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:10:37.391661 30273 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.391880 29646 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:37.380906 29609 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.387755 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.388723 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.390021 29563 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:37.396598 29563 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:37.397164 29563 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:37.397492 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:37.337816 32295 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:37.397928 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.395315 29570 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:37.401261 29646 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.402184 29646 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:37.401041 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.419341 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.420145 29609 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.419420 29565 raft_consensus.cc:2379] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:37.373596 32356 raft_consensus.cc:729] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:37.390703 32206 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:37.429787 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.432570 29609 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.423396 32143 raft_consensus.cc:1067] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:37.415473 32363 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.415673 32251 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:37.436528 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:37.437378 29641 raft_consensus.cc:1799] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Handling vote request from an unknown peer 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.380483 32296 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.443836 29641 raft_consensus.cc:2396] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260807 15:10:37.393903 32105 consensus_queue.cc:1046] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260807 15:10:37.443840 29637 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:10:37.427704 32207 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.446178 29646 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:37.454123 29565 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:37.454969 29565 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:37.455453 29565 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:37.391103 32359 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.459550 29560 raft_consensus.cc:1226] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:37.418365 32295 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.459224 29563 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.464859 29564 raft_consensus.cc:1226] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:37.451093 32251 raft_consensus.cc:686] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:37.472330 29563 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:37.472602 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 92569.2us
W20260807 15:10:37.466755 32373 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.068s user 0.000s sys 0.001s
W20260807 15:10:37.477550 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 45066.4us
I20260807 15:10:37.481986 29531 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:37.485721 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 134812us
I20260807 15:10:37.489395 29531 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.490751 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.489504 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.493472 29533 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.498380 32376 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:37.499018 32163 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.500219 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:37.492328 32287 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:37.500846 29645 raft_consensus.cc:3032] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:37.501156 29645 raft_consensus.cc:729] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:37.502101 32254 raft_consensus.cc:3032] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:37.501921 29645 consensus_queue.cc:260] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.502569 32254 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:37.503082 29645 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:37.505375 32359 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:37.507025 32338 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:37.509609 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:37.483139 32207 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:37.513823 29560 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:37.514634 29565 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.515542 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.519495 29609 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.517402 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.520699 29640 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:37.487666 32369 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:37.503511 32254 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.523264 32296 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:37.524097 32251 consensus_queue.cc:237] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.518070 32246 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260807 15:10:37.496841 32206 consensus_queue.cc:1046] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260807 15:10:37.534330 29645 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:37.535120 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.535610 32207 consensus_queue.cc:1046] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 15:10:37.536558 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.536993 32316 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:37.550957 29488 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:37.537098 32206 raft_consensus.cc:3032] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:37.557619 32206 raft_consensus.cc:729] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:37.558709 32347 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:37.551425 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 58019.2us
I20260807 15:10:37.560109 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.565667 32210 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.568549 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.571171 29450 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.572567 32270 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:37.559275 32347 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.578828 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.580264 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:37.580948 30305 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:37.582540 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:37.580296 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.584828 29484 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:37.585062 32347 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:37.535141 32338 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:37.588454 32338 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.589388 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.540500 29561 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:37.540663 32278 raft_consensus.cc:3037] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:37.541854 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.590736 32338 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:37.542209 32370 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:37.543269 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.544438 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:37.592401 29643 raft_consensus.cc:3032] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:37.592693 29643 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:37.593425 29643 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.593791 30304 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:37.594799 30310 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:37.595193 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:37.596274 31887 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:37.599038 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:37.599876 29483 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 4: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:37.600992 29452 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:10:37.601872 32365 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.297s user 0.000s sys 0.008s
I20260807 15:10:37.602196 29482 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:37.603159 30305 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:37.545050 29565 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:37.545691 29560 raft_consensus.cc:1226] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:37.604206 32310 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:10:37.486837 32375 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.549069 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.551433 29609 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:37.605906 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 54745.1us
I20260807 15:10:37.551710 29531 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:37.607589 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 55969.2us
I20260807 15:10:37.603428 29450 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.546770 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:37.610649 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:37.611510 29481 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:37.613333 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.614806 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:37.615587 29488 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:37.462055 32356 consensus_queue.cc:260] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.621795 29533 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.625314 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.633141 31887 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.633507 29450 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.635320 31887 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:37.636018 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.636711 29609 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.643635 29645 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:37.643937 29450 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:37.644253 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.645649 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.660822 29609 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:37.664183 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:37.633559 32210 raft_consensus.cc:2781] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:37.665096 32360 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.660804 29450 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.667002 32347 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:37.667502 32347 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:37.662463 32288 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:37.669122 32295 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:37.620059 32370 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.670408 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.667937 32347 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:37.670495 29609 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.673815 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.682754 30272 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:37.635562 32016 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:37.684970 29531 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.688246 29481 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:37.664916 29488 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:37.681166 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.631749 32310 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:37.681703 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.692122 29561 raft_consensus.cc:2379] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:37.689626 31887 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:37.690821 29533 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:37.662658 32207 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:37.632408 32363 consensus_queue.cc:1046] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260807 15:10:37.693452 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:37.694485 29365 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 155631us
I20260807 15:10:37.694624 29533 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:37.695114 31887 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:37.690743 29449 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:37.662644 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:37.698444 30272 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:37.699821 30272 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:37.700600 29488 raft_consensus.cc:1261] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:10:37.675830 32210 raft_consensus.cc:686] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:37.702318 31887 raft_consensus.cc:686] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:37.684712 32105 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:37.685117 32158 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:37.684614 32362 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.686146 32344 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:10:37.685223 32356 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:37.707018 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.706208 31887 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.692349 32035 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:37.693547 32338 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:37.727334 29561 raft_consensus.cc:1261] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 15:10:37.745277 32254 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:37.706785 32105 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:37.705085 32292 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.806944 32210 consensus_queue.cc:237] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.809824 32206 consensus_queue.cc:260] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.811329 32206 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:37.707737 29482 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:37.806770 32105 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:37.812171 32371 raft_consensus.cc:3032] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
W20260807 15:10:37.663192 32267 consensus_queue.cc:1159] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "00dd11bf8fd9487580aba733c2996a4a" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 15:10:37.705403 32271 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:37.706833 32335 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.833424 29643 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:37.711181 32278 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:10:37.843487 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 152842us
I20260807 15:10:37.710805 32207 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260807 15:10:37.853857 29449 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.701730 32257 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260807 15:10:37.718628 32246 consensus_queue.cc:1046] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260807 15:10:37.843264 32329 raft_consensus.cc:3032] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:37.843859 32371 raft_consensus.cc:729] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:37.870128 29561 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:37.794384 32310 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.859313 32271 raft_consensus.cc:686] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:37.878484 32271 consensus_queue.cc:237] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.885497 29449 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.887308 32270 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.890041 32369 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:37.902402 29449 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:37.904067 32387 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:37.872267 32329 raft_consensus.cc:729] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:37.909569 29569 raft_consensus.cc:1226] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:37.911839 29479 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 15:10:37.912235 29647 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:37.918354 29643 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:37.922740 32371 consensus_queue.cc:260] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.923581 32277 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:37.897679 32344 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:37.936225 32342 consensus_queue.cc:1046] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:37.938701 32125 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:37.939262 32125 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:37.941274 32125 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:37.941706 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 240736us
I20260807 15:10:37.942651 32266 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:37.944868 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:37.951825 29449 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:37.957048 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.961787 30273 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:37.952652 32355 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:38.025861 32355 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.028752 29379 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 6 to 7, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 7 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260807 15:10:38.044289 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 96002.8us
I20260807 15:10:38.036787 29449 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:10:38.047672 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 98813.1us
I20260807 15:10:38.049672 29643 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:38.050446 29449 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:38.061923 29449 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:38.025900 32277 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:10:38.057029 32387 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:38.081081 32347 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:38.082615 32105 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:37.931828 32375 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260807 15:10:38.084291 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 110781us
I20260807 15:10:38.085141 29481 raft_consensus.cc:1226] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:38.091456 29479 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:38.085865 29484 raft_consensus.cc:1226] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:38.083281 32347 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:38.103014 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:38.050335 32331 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:38.106614 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:37.937042 32344 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:38.080396 29482 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
W20260807 15:10:38.147404 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 88481.8us
I20260807 15:10:38.089956 32249 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:38.103652 32125 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:38.127842 32371 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:38.140235 31887 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:38.109994 29560 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:38.081087 32355 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:38.150676 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:10:38.148826 29365 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 1177fe2445db43e2b8366f33a841a041 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4b092f7f951b4137b5d7810056684270 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:38.152740 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:38.236515 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:10:38.248159 29365 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 99392.5us
I20260807 15:10:38.259423 29481 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:38.237727 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:38.104961 32277 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:38.268975 32277 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.235879 32035 consensus_queue.cc:1046] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260807 15:10:38.262248 32310 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:38.273226 32355 raft_consensus.cc:3032] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:38.273692 32355 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:38.273423 32310 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.250006 32125 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.274632 32355 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:38.241571 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 87296.4us
I20260807 15:10:38.088610 32257 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:37.950387 32329 consensus_queue.cc:260] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
W20260807 15:10:38.240326 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 64193.9us
W20260807 15:10:38.239722 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 110941us
I20260807 15:10:38.264127 29609 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:38.244122 32387 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:38.244050 32391 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260807 15:10:38.311861 32331 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:10:38.261106 32105 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:38.296532 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:38.298871 29647 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 15:10:38.299482 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:38.313841 32338 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:38.314402 32338 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:38.315384 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:38.315514 29449 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:38.299922 32293 consensus_queue.cc:1046] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 15:10:38.277002 32125 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:38.278771 32257 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.302778 32355 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:38.293921 32143 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
W20260807 15:10:38.303581 32395 log.cc:924] Time spent T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260807 15:10:38.306891 32377 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:38.246104 32363 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:38.246348 32342 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:38.308090 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:38.313531 29569 raft_consensus.cc:2379] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:38.340478 29479 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 15:10:38.327294 30272 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:38.275823 32310 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:38.342027 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:38.340175 32356 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:38.346939 29641 raft_consensus.cc:2379] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 8: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:38.353322 32143 raft_consensus.cc:686] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:38.361490 29646 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 15:10:38.384645 32296 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260807 15:10:38.389213 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 51744.9us
I20260807 15:10:38.354585 32292 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:10:38.413308 32254 consensus_meta.cc:287] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.613s user 0.009s sys 0.002s
I20260807 15:10:38.353494 32271 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260807 15:10:38.345973 32377 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:38.437086 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 44295us
I20260807 15:10:38.361577 32338 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:38.446255 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 100621us
W20260807 15:10:38.424140 32206 consensus_meta.cc:287] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.605s user 0.010s sys 0.001s
I20260807 15:10:38.354957 32342 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.463964 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:38.465168 29565 raft_consensus.cc:2379] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:38.351598 32363 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.427708 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:38.476119 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 124070us
I20260807 15:10:38.433393 32207 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:38.479511 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:38.480301 29637 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:38.481482 29449 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:38.481578 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:38.483106 32143 consensus_queue.cc:237] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:38.488545 32257 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:38.495251 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:38.496219 29569 raft_consensus.cc:2379] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:38.485466 30304 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:38.500936 32257 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:38.501590 32257 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.484555 32207 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:38.505548 29637 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:38.506716 32207 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:38.505551 29642 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:38.520254 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:38.521061 29569 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:38.521867 32377 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:38.523247 29646 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 15:10:38.525060 29608 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:38.529723 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:38.530731 29488 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:38.481987 32344 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:38.543329 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:38.525493 32288 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:38.560423 29483 raft_consensus.cc:1261] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:38.566711 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:38.567514 29646 raft_consensus.cc:595] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:38.567945 29646 raft_consensus.cc:603] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:10:38.569232 29452 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:38.547639 32251 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:10:38.574663 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 214462us
I20260807 15:10:38.582005 29641 raft_consensus.cc:1261] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:38.553270 32410 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:38.558885 32288 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:38.590507 30308 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 15:10:38.566871 32404 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:38.574941 32338 raft_consensus.cc:2781] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:38.547884 32357 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260807 15:10:38.609572 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:38.598510 32288 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:38.591995 32410 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:38.586102 32016 consensus_queue.cc:1035] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260807 15:10:38.613296 32338 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:38.590687 32251 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.649240 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:38.656426 29646 raft_consensus.cc:595] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:38.668081 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:38.638662 32406 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260807 15:10:38.676394 29642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59992 (request call id 2287) took 1132 ms. Trace:
I20260807 15:10:38.647617 32338 raft_consensus.cc:3037] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:38.647452 32249 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:38.640261 32410 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:38.678457 29642 rpcz_store.cc:276] 0807 15:10:37.544354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:37.546162 (+ 1808us) service_pool.cc:227] Handling call
0807 15:10:38.676129 (+1129967us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54003c8a54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:38.676244 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1991538048}
I20260807 15:10:38.692812 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:38.707208 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 105057us
I20260807 15:10:38.613932 32404 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:38.715477 32404 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:38.718061 29483 raft_consensus.cc:1261] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:38.719583 29609 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:38.721405 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:38.722308 30308 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:38.659747 32342 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:38.710703 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 72154.5us
I20260807 15:10:38.725277 29452 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:38.731467 30272 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:38.733863 32404 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:38.655797 32359 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260807 15:10:38.745039 32370 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:38.750989 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:38.751673 29642 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:38.751806 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:38.752558 29641 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:38.734669 32404 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:38.741532 32270 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:38.805928 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:38.741297 32363 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:38.740360 32416 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:10:38.747707 32287 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 15:10:38.820281 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 63454.1us
I20260807 15:10:38.821022 30272 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:38.814785 32270 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:38.859467 30272 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:38.841982 32270 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:38.924767 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 54797.1us
W20260807 15:10:38.858294 32355 consensus_meta.cc:287] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.523s user 0.005s sys 0.012s
I20260807 15:10:38.946715 32251 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:38.876281 32253 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:38.870028 32421 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:38.818970 32414 consensus_queue.cc:1035] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260807 15:10:38.927745 32404 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:39.044238 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 307834us
I20260807 15:10:39.042583 32421 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:39.159004 32421 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:39.283213 30309 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 15:10:39.322547 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:39.314370 32377 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:39.323510 32377 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:39.333572 32266 consensus_meta.cc:287] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 1.390s user 0.013s sys 0.004s
I20260807 15:10:39.334792 29486 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:39.309774 32016 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.301640 32271 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:39.338752 32405 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.327785 32377 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:39.402099 32338 consensus_meta.cc:287] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.679s user 0.015s sys 0.000s
I20260807 15:10:39.387792 32219 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.358163 32442 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:39.426887 32421 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.371708 32016 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:39.389573 32409 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s user 0.006s sys 0.011s
W20260807 15:10:39.401155 29531 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.645s user 0.010s sys 0.023s
W20260807 15:10:39.443496 29531 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.687s user 0.010s sys 0.024s
I20260807 15:10:39.381711 32271 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:39.434623 32380 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s user 0.018s sys 0.015s
I20260807 15:10:39.434067 32219 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.450721 32387 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:39.451339 32441 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.453380 32016 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.457248 32371 raft_consensus.cc:979] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
W20260807 15:10:39.437985 32409 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s user 0.006s sys 0.011s
W20260807 15:10:39.442958 32125 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.578s user 0.010s sys 0.023s
W20260807 15:10:39.446785 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 710244us
I20260807 15:10:39.400332 32405 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:39.481773 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 195854us
I20260807 15:10:39.434118 32338 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:39.475167 32380 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s user 0.018s sys 0.016s
W20260807 15:10:39.488215 29453 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.534s user 0.009s sys 0.012s
I20260807 15:10:39.476711 32387 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:39.491528 29453 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.538s user 0.009s sys 0.013s
W20260807 15:10:39.485314 32125 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.632s user 0.011s sys 0.023s
W20260807 15:10:39.494848 29452 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.539s user 0.038s sys 0.042s
I20260807 15:10:39.481410 32246 raft_consensus.cc:1067] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
W20260807 15:10:39.497502 29452 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.542s user 0.038s sys 0.043s
W20260807 15:10:39.497869 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 542462us
I20260807 15:10:39.496347 29564 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:39.436854 32442 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:39.524187 29450 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.711s user 0.008s sys 0.040s
W20260807 15:10:39.524686 29450 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.712s user 0.008s sys 0.040s
I20260807 15:10:39.529659 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:39.480430 32441 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.520749 32207 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.534780 29637 raft_consensus.cc:2379] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:39.527678 32246 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:39.572804 32219 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.573252 32421 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.573760 32219 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.556461 32440 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:39.574568 32219 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:39.567312 32288 consensus_meta.cc:287] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.940s user 0.012s sys 0.006s
I20260807 15:10:39.576557 32288 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:39.580351 32442 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.582798 32338 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.570412 32246 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:39.584486 32270 consensus_meta.cc:287] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.598s user 0.011s sys 0.003s
I20260807 15:10:39.544183 32375 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.597252 32219 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.596855 32375 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
W20260807 15:10:39.591465 32416 consensus_meta.cc:287] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.770s user 0.012s sys 0.006s
I20260807 15:10:39.592353 32246 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:39.553921 32312 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:39.596174 32407 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 1.196s user 0.004s sys 0.010s
I20260807 15:10:39.574903 32440 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:39.573807 32450 log.cc:924] Time spent T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.063s user 0.000s sys 0.001s
I20260807 15:10:39.552996 32207 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:39.623654 32219 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:39.668988 32219 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.673292 32219 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.623080 32455 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.680171 29645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59992 (request call id 2301) took 1392 ms. Trace:
I20260807 15:10:39.681638 32440 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.680766 29645 rpcz_store.cc:276] 0807 15:10:38.287713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:38.287967 (+ 254us) service_pool.cc:227] Handling call
0807 15:10:38.288297 (+ 330us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:38.288660 (+ 363us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:38.288687 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:38.289150 (+ 463us) log.cc:842] Serialized 26 byte log entry
0807 15:10:38.400276 (+111126us) raft_consensus.cc:1631] Marking committed up to 2
0807 15:10:38.400338 (+ 62us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:38.400451 (+ 113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:39.595771 (+1195320us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b24001f3ec8. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8cf4cf4 00007f94d8cf2dfb 00007f94d8d81559 00007f94d8d811e5 00007f94d8d8082d 00007f94dba2f46e 00007f94dba46c0c 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551
0807 15:10:39.679615 (+ 83844us) raft_consensus.cc:1671] finished
0807 15:10:39.679646 (+ 31us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:39.680084 (+ 438us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3202,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5228,"spinlock_wait_cycles":18146176,"thread_start_us":66236,"threads_started":1,"wal-append.queue_time_us":104122}
I20260807 15:10:39.675122 32312 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.657104 32416 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:39.585345 32270 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.686760 30310 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260807 15:10:39.705314 32375 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:10:39.705862 32257 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:39.677452 32441 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.584945 32452 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260807 15:10:39.596048 32271 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.707775 32207 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:39.712039 32105 raft_consensus.cc:3032] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:39.712908 32105 raft_consensus.cc:729] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:39.718869 32270 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.715955 32105 consensus_queue.cc:260] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:39.720564 32105 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:39.678325 32288 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.726451 32405 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:39.733107 32410 consensus_meta.cc:287] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.997s user 0.013s sys 0.007s
I20260807 15:10:39.733409 32329 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:39.733920 32410 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:39.738209 32312 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.680272 32455 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.804454 32249 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.844339 32293 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:39.842967 32435 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:39.856499 32335 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:39.863318 32266 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:39.864403 32446 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:39.864639 32266 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:39.865537 32446 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.857880 32335 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.869760 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:39.871138 29484 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:39.872364 32420 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:39.873481 32016 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:39.873371 32420 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.871711 32335 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.845587 32293 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.875255 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:39.873896 32266 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.803099 32270 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:39.845463 32249 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:39.787002 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:39.859364 32362 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:39.900585 32435 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.909997 29487 raft_consensus.cc:2379] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 3: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
W20260807 15:10:39.899600 29481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s user 0.034s sys 0.036s
I20260807 15:10:39.746555 32455 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.888069 32016 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:39.921254 32446 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.934146 29479 raft_consensus.cc:2354] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5.
W20260807 15:10:39.933174 29481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s user 0.035s sys 0.036s
I20260807 15:10:39.916783 32312 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:39.744853 32387 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:39.941990 32387 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:39.945463 32435 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.952900 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 602) took 2444 ms. Trace:
I20260807 15:10:39.953549 29486 rpcz_store.cc:276] 0807 15:10:37.508186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:37.510103 (+ 1917us) service_pool.cc:227] Handling call
0807 15:10:37.510411 (+ 308us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:39.335225 (+1824814us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:39.952252 (+617027us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54000f8cd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:39.952634 (+ 382us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4194798848}
I20260807 15:10:39.955298 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:39.957619 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:39.959048 29564 raft_consensus.cc:2379] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:39.925879 32270 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.961786 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:39.962536 32270 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.962652 29645 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:39.937556 29484 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:39.937268 32380 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:39.978554 32380 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:39.980405 29646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40014 (request call id 35) took 1347 ms. Trace:
I20260807 15:10:39.981240 32319 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:39.982205 32312 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:39.985132 32312 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:39.990238 32293 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:39.980867 29646 rpcz_store.cc:276] 0807 15:10:38.632446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:38.632634 (+ 188us) service_pool.cc:227] Handling call
0807 15:10:39.979980 (+1347346us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b54003c7b54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdbebc3 00007f94e0d0881a 00007f94da3fbd04 00007f94da3fbc92 00007f94da3fbbc1 00007f94da3fbb3c 00007f94da3fadf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:39.980139 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7480064}
W20260807 15:10:40.005188 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 71175.9us
W20260807 15:10:39.996681 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 379121us
I20260807 15:10:40.010743 32335 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:40.011446 32016 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.011799 32335 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.014678 32420 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.023813 32249 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:40.016367 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.003522 32410 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:39.981980 32319 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:40.050207 32319 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:39.935813 32362 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:40.057507 32457 log.cc:924] Time spent T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.114s user 0.001s sys 0.000s
I20260807 15:10:40.059260 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2656) took 1367 ms. Trace:
I20260807 15:10:40.059705 29569 rpcz_store.cc:276] 0807 15:10:38.691812 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:38.692007 (+ 195us) service_pool.cc:227] Handling call
0807 15:10:38.734260 (+ 42253us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:38.734557 (+ 297us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 15:10:39.619062 (+884505us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b18002964a0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94dba5382c 00007f94d8e7e9dc 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e99155 00007f94df799167 00007f94dbdce807 00007f94dbdddf0f
0807 15:10:39.619288 (+ 226us) log.cc:842] Serialized 14 byte log entry
0807 15:10:40.037281 (+417993us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:40.058641 (+ 21360us) raft_consensus.cc:1631] Marking committed up to 2
0807 15:10:40.058814 (+ 173us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:40.058906 (+ 92us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:40.059076 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25567,"prepare.queue_time_us":151425,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":46657,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":196,"spinlock_wait_cycles":521485184,"thread_start_us":663664,"threads_started":2}
I20260807 15:10:40.060703 32362 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.061693 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:40.062865 30305 raft_consensus.cc:3037] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:40.064913 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 619) took 1752 ms. Trace:
I20260807 15:10:40.065315 29481 rpcz_store.cc:276] 0807 15:10:38.312407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:38.312574 (+ 167us) service_pool.cc:227] Handling call
0807 15:10:38.312852 (+ 278us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:38.393212 (+ 80360us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:38.393267 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:39.384468 (+991201us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b2c00060e78. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94da7a7e11 00007f94da7b7442 00007f94dbdffc11 00007f94dbdc458a 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772
0807 15:10:39.385162 (+ 694us) log.cc:842] Serialized 26 byte log entry
0807 15:10:40.015825 (+630663us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:40.033682 (+ 17857us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:40.033824 (+ 142us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:40.064397 (+ 30573us) raft_consensus.cc:1671] finished
0807 15:10:40.064431 (+ 34us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:40.064784 (+ 353us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9224,"raft.queue_time_us":42429,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":9812,"spinlock_wait_cycles":54460800,"thread_start_us":620292,"threads_started":2,"wal-append.queue_time_us":557554}
I20260807 15:10:40.067363 32380 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.052179 29564 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:40.077148 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.077806 32408 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:40.079523 32356 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.078686 32408 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.084335 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.076525 32335 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.104139 32414 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:40.105049 32414 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.089330 32266 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.107348 32266 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.111366 32266 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.112373 32335 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.116912 32335 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.117743 29565 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:40.118517 29565 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:40.121534 29565 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:40.089695 32410 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.098083 32356 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.113338 32414 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.127130 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.123512 32420 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:40.139081 29646 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:40.144866 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.150401 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.148089 32270 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:40.155670 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.155620 32270 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.156718 29570 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:40.156774 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.157727 32310 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:40.150072 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:40.158353 32270 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.158906 29643 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:40.158591 32310 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.161900 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:40.162698 29561 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:40.148845 32338 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:40.172894 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:40.176126 32385 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:40.183881 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.165175 32338 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.166478 32420 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.173353 32319 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:40.177627 32408 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:40.184590 32293 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:40.191188 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.180178 32329 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:40.193361 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.194813 30310 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 5
I20260807 15:10:40.183843 32335 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.181020 32270 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.166355 32410 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.195580 32329 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.199879 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.200873 32405 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.201113 32288 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:40.201720 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.205228 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.205180 30272 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:40.205756 30312 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
W20260807 15:10:40.204713 32468 log.cc:924] Time spent T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.072s user 0.000s sys 0.001s
I20260807 15:10:40.208074 29609 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:40.216260 32288 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.217521 32405 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.221999 32207 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.231050 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.212325 32319 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.236538 29570 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:40.230706 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:40.230664 32249 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.248651 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.248884 32249 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.249851 29645 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
W20260807 15:10:40.252977 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 110185us
I20260807 15:10:40.255527 29642 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:40.233673 32356 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.228422 32293 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.229846 32270 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.235909 32385 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.263134 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.256757 32310 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.266461 29480 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:40.269340 29379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 372) took 6957 ms. Trace:
I20260807 15:10:40.271983 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.263692 32420 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.270797 32370 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:40.272110 32391 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:40.270021 32405 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.279009 29646 raft_consensus.cc:2396] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260807 15:10:40.277505 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 99323.7us
I20260807 15:10:40.275785 32312 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:40.226681 32207 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.258544 32414 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:40.278860 32391 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.291213 29449 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:40.287942 30305 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:40.298915 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.298421 32391 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:40.304980 32253 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.288594 32414 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.312547 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.278601 32266 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260807 15:10:40.313323 32253 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.305106 32370 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.318581 32387 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:40.319156 32207 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.319340 32410 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.314248 29641 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:40.306041 32329 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.313385 32338 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.328078 32288 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.329931 32385 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.331630 32293 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.336164 32319 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:40.336417 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.338506 30312 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:40.301872 32420 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:40.323172 32387 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:40.339825 32420 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.340447 32387 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:40.341027 30274 leader_election.cc:398] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5.
I20260807 15:10:40.341526 30274 leader_election.cc:401] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:10:40.342842 29479 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:40.367571 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.343163 32447 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:40.344378 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.368799 32253 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.344843 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.345189 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.345831 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.346117 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.346557 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.346787 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.348219 32408 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:40.348331 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.348755 29645 raft_consensus.cc:1261] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 15:10:40.352941 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:40.354380 29365 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 1177fe2445db43e2b8366f33a841a041 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4b092f7f951b4137b5d7810056684270 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:40.343272 29484 raft_consensus.cc:1226] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
W20260807 15:10:40.321017 32105 consensus_meta.cc:287] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.540s user 0.009s sys 0.009s
I20260807 15:10:40.380139 29481 raft_consensus.cc:1226] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:40.380105 32270 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.370623 29483 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:40.271597 29379 rpcz_store.cc:276] 0807 15:10:33.312081 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:33.312218 (+ 137us) service_pool.cc:227] Handling call
0807 15:10:40.265708 (+6953490us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:38.392200 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:38.524119 (+131919us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:38.524241 (+ 122us) write_op.cc:435] Acquired schema lock
0807 15:10:38.524302 (+ 61us) tablet.cc:660] Decoding operations
0807 15:10:38.524771 (+ 469us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:38.534973 (+ 10202us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:38.537034 (+ 2061us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:10:38.556650 (+ 19616us) tablet.cc:699] Row locks acquired
0807 15:10:38.558999 (+ 2349us) write_op.cc:260] PREPARE: finished
0807 15:10:38.575619 (+ 16620us) write_op.cc:270] Start()
0807 15:10:38.590103 (+ 14484us) write_op.cc:276] Timestamp: P: 1786115438574104 usec, L: 0
0807 15:10:38.592638 (+ 2535us) op_driver.cc:331] REPLICATION: starting
0807 15:10:38.662904 (+ 70266us) log.cc:842] Serialized 539 byte log entry
0807 15:10:39.507501 (+844597us) op_driver.cc:444] REPLICATION: finished
0807 15:10:40.043317 (+535816us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b180039ae40. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:10:40.043688 (+ 371us) write_op.cc:301] APPLY: starting
0807 15:10:40.043883 (+ 195us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:40.044147 (+ 264us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:40.044172 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:40.044648 (+ 476us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:40.045138 (+ 490us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:10:40.045219 (+ 81us) write_op.cc:312] APPLY: finished
0807 15:10:40.045786 (+ 567us) log.cc:842] Serialized 23 byte log entry
0807 15:10:40.083551 (+ 37765us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:40.089185 (+ 5634us) write_op.cc:454] Released schema lock
0807 15:10:40.095551 (+ 6366us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:40.131314 (+ 35763us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:40.132805 (+ 1491us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":419108,"apply.run_cpu_time_us":4323,"apply.run_wall_time_us":98715,"num_ops":1,"prepare.queue_time_us":291139,"prepare.run_cpu_time_us":26132,"prepare.run_wall_time_us":376857,"raft.queue_time_us":649846,"raft.run_cpu_time_us":64457,"raft.run_wall_time_us":401023,"replication_time_us":914660,"spinlock_wait_cycles":8589056,"thread_start_us":1133558,"threads_started":4,"wal-append.queue_time_us":128719}]]}
I20260807 15:10:40.388473 32411 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:40.398155 29561 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:40.389103 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.389482 29452 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:40.389937 30310 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:40.390066 32408 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.392010 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.391539 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:40.388945 29642 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:40.397863 29565 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.404632 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:40.406304 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 82566.3us
I20260807 15:10:40.406701 29566 raft_consensus.cc:1226] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:40.413717 29565 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.414072 30309 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:40.412173 29643 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:40.392647 32362 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:40.413777 32410 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:40.417258 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 76483.7us
I20260807 15:10:40.426421 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.431023 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.412585 32270 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:40.409611 32447 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5.
I20260807 15:10:40.433509 29480 raft_consensus.cc:2396] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260807 15:10:40.435439 32370 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.435693 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:40.438705 29563 raft_consensus.cc:3037] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 3
W20260807 15:10:40.440724 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 233092us
I20260807 15:10:40.442546 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.443550 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.444301 32463 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:40.444738 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.445266 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.435685 32253 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:40.445772 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.446514 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:40.446283 32253 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.447072 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.448201 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.449131 32253 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.449910 29382 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 365) took 7115 ms. Trace:
I20260807 15:10:40.437949 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:40.450311 29382 rpcz_store.cc:276] 0807 15:10:33.334067 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:33.334971 (+ 904us) service_pool.cc:227] Handling call
0807 15:10:40.449691 (+7114720us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6789,"reported_tablets":7}
I20260807 15:10:40.445497 29568 raft_consensus.cc:2379] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:40.452191 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.454634 32249 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.455180 32410 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.456254 32452 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.457106 32452 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.457891 32410 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:40.447698 29564 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:40.462260 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.441486 29452 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:40.461897 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.447656 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.468927 29563 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:40.436606 32270 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:40.473206 29570 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:40.477586 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.478808 32452 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:40.479794 32408 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.480262 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.480646 29479 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
W20260807 15:10:40.493358 32472 log.cc:924] Time spent T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.116s user 0.000s sys 0.001s
I20260807 15:10:40.494421 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.497459 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.502336 32105 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:40.503399 32105 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.471177 32414 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.487882 32270 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:40.511440 30273 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:40.483505 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 59621.6us
I20260807 15:10:40.486740 30303 raft_consensus.cc:2354] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3.
I20260807 15:10:40.459801 32362 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.519105 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.520892 32362 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:40.490783 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.407335 32411 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.512701 32105 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.492561 32391 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.477685 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.516462 29643 raft_consensus.cc:1226] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260807 15:10:40.517282 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.518241 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:40.518416 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.491168 32249 raft_consensus.cc:2781] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
W20260807 15:10:40.515609 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 55779.1us
I20260807 15:10:40.532189 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:40.541097 29452 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:40.543012 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.543994 29647 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:40.546056 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.546994 29646 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
I20260807 15:10:40.524077 32447 raft_consensus.cc:2741] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 15:10:40.549939 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.551549 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.549974 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.559068 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.560529 29449 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:40.557668 29488 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
W20260807 15:10:40.565864 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 50516us
I20260807 15:10:40.567786 32356 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:40.568440 32356 raft_consensus.cc:686] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:40.572073 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.572170 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.573776 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.574152 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.574470 29637 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:40.575035 29638 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:40.540788 32249 raft_consensus.cc:686] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:40.576453 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.577684 32249 consensus_queue.cc:237] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.579213 32411 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:40.580331 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.584093 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.588331 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:40.590672 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 47880.7us
I20260807 15:10:40.595269 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 218) took 7049 ms. Trace:
I20260807 15:10:40.595860 29378 rpcz_store.cc:276] 0807 15:10:33.481345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:33.481572 (+ 227us) service_pool.cc:227] Handling call
0807 15:10:40.524349 (+7042777us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":85972,"reported_tablets":7}
I20260807 15:10:40.603844 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.606189 29449 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:40.608100 32385 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:40.611038 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.612314 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.612499 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.613025 32391 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.603224 32420 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:40.613834 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.613984 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.602334 32310 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:40.615139 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.615810 32310 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.616281 32310 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:40.617148 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.617864 29488 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:40.611809 29481 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:40.620265 30272 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:40.621954 30272 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:40.622876 30272 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:40.607968 32266 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 15:10:40.624189 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:40.624540 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.624886 29641 raft_consensus.cc:3032] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:40.625217 29641 raft_consensus.cc:729] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:40.627230 29449 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:40.624189 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.623597 29608 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:40.635001 32335 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:40.635648 32335 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:40.636283 32335 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:40.636932 32253 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:40.638511 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.639307 29637 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:40.635088 32288 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:40.640410 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.640730 32288 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.642457 32288 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:40.643574 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.644943 32277 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.645498 32277 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.646652 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.647239 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.647954 32387 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.649124 29480 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:40.635686 32447 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:40.642315 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.640560 32310 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.625952 29641 consensus_queue.cc:260] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:40.669811 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 46282.6us
I20260807 15:10:40.569687 32356 consensus_queue.cc:237] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.677039 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.678706 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.654374 32447 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.683189 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.688669 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.689323 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.689936 32329 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:40.690423 32329 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:40.690800 32329 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:40.690972 29641 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:40.691195 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.692457 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.692999 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.685758 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.694147 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:40.695084 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.654325 32277 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.695744 29640 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:40.696621 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.687269 29608 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:40.695164 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.693010 29645 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:40.675556 32105 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.634506 32270 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.708405 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.711395 29449 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:40.698401 29379 catalog_manager.cc:5495] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 3, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } }
I20260807 15:10:40.706245 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:40.713829 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.701259 29641 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:40.723330 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.723718 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.724802 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.730770 29608 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:40.697283 32447 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:40.738022 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:40.743641 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 45713.2us
I20260807 15:10:40.748906 29608 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:40.745940 29449 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:40.752285 29479 raft_consensus.cc:2379] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:40.742537 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:40.716421 32362 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:40.759573 29449 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:40.761454 29608 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:40.728521 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.745201 32463 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:40.753870 32452 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:40.750656 32266 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:40.740624 29379 catalog_manager.cc:5495] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 4 to 5, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 5 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:40.763005 32338 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:40.790858 32277 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:40.744768 32105 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.796466 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.796758 32387 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.781435 32370 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:40.799194 29642 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:40.802538 32266 raft_consensus.cc:686] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:40.797127 32270 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:40.805563 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 90382.5us
I20260807 15:10:40.807669 29379 catalog_manager.cc:5495] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 3 to 4, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 1 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:40.782142 32463 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:40.815666 29609 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:40.816789 29480 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:10:40.813405 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 52071.6us
I20260807 15:10:40.815686 30272 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:40.800693 32277 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:40.820775 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:40.822983 29565 raft_consensus.cc:2354] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:40.812528 32312 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:40.812165 32411 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:40.822371 29609 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:40.832697 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:40.833750 32414 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:40.835386 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:40.836073 30312 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:40.836140 29379 catalog_manager.cc:5495] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 4 to 5, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 5 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:40.837059 29533 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:40.838495 29379 catalog_manager.cc:5495] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 2 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:40.837972 32414 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:40.841080 32414 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:40.818747 32463 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:40.840824 29379 catalog_manager.cc:5495] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:40.846094 29379 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 4 to 6, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:40.843144 32329 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.855456 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.819011 32452 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:10:40.857373 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 44670.6us
I20260807 15:10:40.860073 32207 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:40.860787 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.861558 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.861892 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.862982 32420 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:40.863168 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.863556 32420 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.863942 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:40.865556 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 45562.3us
I20260807 15:10:40.867081 30312 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:40.867379 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:40.869964 29533 leader_election.cc:398] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3.
I20260807 15:10:40.870465 29533 leader_election.cc:401] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:10:40.824622 32277 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:40.855358 29379 catalog_manager.cc:5495] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:40.847594 32253 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:40.887066 29609 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:40.847451 32310 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:40.854686 32414 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:40.895740 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.898447 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:40.904757 32293 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:40.864980 32411 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:40.864753 32312 raft_consensus.cc:686] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:40.905409 32293 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:40.889721 32452 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:40.917237 32452 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:40.917850 32452 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:40.917634 32293 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:40.921092 32329 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:40.916754 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 80487.3us
W20260807 15:10:40.916810 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 45613.3us
I20260807 15:10:40.911397 29609 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:40.913393 29608 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:40.892964 29379 catalog_manager.cc:5495] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: config changed from index 4 to 5, VOTER 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) evicted. New cstate: current_term: 2 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:40.907719 29638 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d87368aeb34548079f36255279bee400"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:40.945441 29452 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:40.951191 29608 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:40.950685 29379 catalog_manager.cc:5495] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } }
I20260807 15:10:40.950105 29638 raft_consensus.cc:595] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:40.951861 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 82077.1us
I20260807 15:10:40.962558 30273 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:40.964005 29608 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:40.965216 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:40.895797 32288 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.975461 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:40.976274 29486 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:40.927392 32293 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:40.955489 32319 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:40.910959 32266 consensus_queue.cc:237] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:40.990763 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 63379us
I20260807 15:10:40.952080 32329 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:40.952173 32410 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:40.960409 32387 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:10:40.967182 32253 raft_consensus.cc:686] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:40.993959 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:41.000758 29481 raft_consensus.cc:2379] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 4: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:40.996567 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:41.001603 29483 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:41.003830 32493 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:41.004493 32288 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:41.004709 32493 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.005051 32277 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:41.005264 32319 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:40.976002 32446 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3.
I20260807 15:10:41.007969 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:41.016759 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:41.007344 32493 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:41.019006 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:41.022850 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 58954.9us
I20260807 15:10:41.017212 32498 consensus_queue.cc:1046] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260807 15:10:41.024688 30309 raft_consensus.cc:2354] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7.
I20260807 15:10:41.026579 29608 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:41.031679 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:41.034220 29450 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:41.035331 32385 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:41.037120 29450 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:41.038806 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:41.022595 29531 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:41.023406 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 263919us
W20260807 15:10:41.009806 32484 log.cc:924] Time spent T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.218s user 0.001s sys 0.003s
I20260807 15:10:41.043257 32319 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:41.007279 32277 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:41.048612 29449 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:41.058106 32420 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:41.058393 32310 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:41.016886 32387 raft_consensus.cc:686] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:41.007588 32483 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:41.060389 32387 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.062076 32411 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:41.052711 32288 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:41.007459 32461 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.165s
I20260807 15:10:41.049690 32338 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:41.065115 29449 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:41.069856 32253 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.072832 29449 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:41.076771 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 82981.5us
I20260807 15:10:41.080344 29531 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:41.051358 32447 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.084820 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:41.086148 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:41.091116 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:41.091464 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:41.094481 29564 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:41.092532 30274 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:41.093674 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:41.087952 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:41.100045 30274 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:41.075764 32338 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:41.020103 32312 consensus_queue.cc:237] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:41.108532 32482 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:41.124267 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:41.126163 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:41.129719 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:10:41.130532 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 91800.3us
I20260807 15:10:41.090325 32288 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:41.134261 29638 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:41.135231 29638 raft_consensus.cc:595] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:41.135697 29638 raft_consensus.cc:603] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:10:41.074579 32335 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.101307 32385 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:41.182235 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:10:41.185787 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 68388.1us
I20260807 15:10:41.133458 32498 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:41.187753 32498 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:41.188212 32498 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:41.192620 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:41.111241 32338 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:41.199338 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 66437.4us
I20260807 15:10:41.243503 30310 raft_consensus.cc:1226] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:41.246299 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:41.248147 29533 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:41.192907 32387 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:41.258412 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:41.259606 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:41.267068 29566 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:41.196694 32338 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:41.226897 32288 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.242939 32293 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:41.280719 29483 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
W20260807 15:10:41.280990 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 161276us
I20260807 15:10:41.086283 32501 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:41.285799 29609 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:41.287408 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50455.4us
I20260807 15:10:41.284801 29486 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:41.116920 32506 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:10:41.337858 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 52194.7us
I20260807 15:10:41.343226 29609 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:41.341130 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 45398.1us
W20260807 15:10:41.345432 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 109032us
W20260807 15:10:41.341291 32487 log.cc:924] Time spent T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.070s user 0.000s sys 0.001s
I20260807 15:10:41.290124 32501 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:10:41.452852 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 88576.3us
W20260807 15:10:41.357009 32485 log.cc:924] Time spent T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.565s user 0.003s sys 0.000s
I20260807 15:10:41.345126 32329 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:41.492805 30311 raft_consensus.cc:1261] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:41.461807 32319 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:41.450865 32501 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:41.345798 32414 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:41.466249 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 125292us
I20260807 15:10:41.346699 32497 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:41.470379 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 127249us
I20260807 15:10:41.336272 32387 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:41.504158 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 325543us
I20260807 15:10:41.510492 29609 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:41.465343 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 120593us
I20260807 15:10:41.515273 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:41.518654 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:41.488183 32249 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:41.489946 32447 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:41.585655 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 119326us
W20260807 15:10:41.585655 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 123082us
I20260807 15:10:41.587352 29570 raft_consensus.cc:2379] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:41.602329 29450 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:41.517323 32319 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:41.609476 29450 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:41.521777 32329 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:41.521513 32362 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 15:10:41.619215 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 368238us
W20260807 15:10:41.640859 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 123830us
I20260807 15:10:41.605073 32335 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:41.618502 32249 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:41.678892 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:41.693310 29531 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:41.746855 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:41.674233 32266 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s user 0.005s sys 0.005s
W20260807 15:10:41.752487 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 99046.3us
W20260807 15:10:41.756405 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 232171us
W20260807 15:10:41.747918 29379 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.730s user 0.031s sys 0.066s
I20260807 15:10:41.667862 32288 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:41.751969 29531 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:41.523800 32497 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.768172 29487 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:10:41.773391 29487 raft_consensus.cc:595] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
W20260807 15:10:41.747918 32463 consensus_meta.cc:287] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.869s user 0.012s sys 0.000s
I20260807 15:10:41.676827 32105 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:41.773867 29487 raft_consensus.cc:603] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 15:10:41.764158 32492 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.652s user 0.001s sys 0.003s
W20260807 15:10:41.768931 32510 log.cc:924] Time spent T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.399s user 0.001s sys 0.000s
W20260807 15:10:41.776813 29379 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.759s user 0.032s sys 0.066s
W20260807 15:10:41.768059 32521 log.cc:924] Time spent T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.072s user 0.000s sys 0.001s
W20260807 15:10:41.763098 32504 log.cc:924] Time spent T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.351s user 0.000s sys 0.001s
I20260807 15:10:41.681088 32249 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:41.756891 32266 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s user 0.006s sys 0.005s
I20260807 15:10:41.798648 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:41.801369 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:41.805771 32527 log.cc:924] Time spent T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260807 15:10:41.753700 32420 raft_consensus.cc:3032] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Stepping down as leader of term 5
W20260807 15:10:41.785216 32498 consensus_meta.cc:287] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.596s user 0.006s sys 0.007s
W20260807 15:10:41.774649 32312 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s user 0.015s sys 0.015s
I20260807 15:10:41.823884 29609 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:41.820868 32312 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s user 0.015s sys 0.015s
I20260807 15:10:41.852696 32532 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:41.854894 32532 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:41.855386 32532 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:41.855645 32387 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:41.856805 32528 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260807 15:10:41.857234 32529 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 15:10:41.828011 30273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.653s (SENT) [suppressed 1 similar messages]
I20260807 15:10:41.793514 32463 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:41.820472 32420 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:41.826869 32362 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:41.847687 32380 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:41.854144 32414 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:41.883275 29641 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:41.888063 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:41.890678 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:41.891371 29480 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:41.891161 32420 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:41.891996 32509 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:41.892699 32511 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:41.892817 32420 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:41.893473 32542 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:41.894057 32542 raft_consensus.cc:686] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:10:41.891932 29566 consensus_meta.cc:287] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.624s user 0.007s sys 0.001s
I20260807 15:10:41.895227 29566 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:41.895093 32542 consensus_queue.cc:237] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:41.850476 32461 consensus_queue.cc:1046] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260807 15:10:41.826481 32498 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
W20260807 15:10:41.886956 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 88382.2us
I20260807 15:10:41.879119 32380 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:41.906021 32498 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:10:41.907171 32380 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:41.907927 32497 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:41.878365 32362 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:41.919281 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 167449us
W20260807 15:10:41.923753 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 95780.5us
I20260807 15:10:41.926403 29531 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:41.927619 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:41.932914 32362 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:41.933456 32338 consensus_meta.cc:287] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.655s user 0.009s sys 0.002s
I20260807 15:10:41.933925 32338 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:41.934695 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:41.935756 32338 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:41.938313 32516 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:41.940294 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 332483us
I20260807 15:10:41.940425 32531 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:41.942104 29450 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:41.944937 32277 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:41.901540 32501 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:41.949043 32519 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:41.949266 32452 consensus_meta.cc:287] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 1.031s user 0.013s sys 0.000s
I20260807 15:10:41.949710 32452 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.952025 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 15:10:41.954195 32463 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:41.955072 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260807 15:10:41.956085 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 182516us
I20260807 15:10:41.956739 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:41.957604 29570 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:41.959618 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:41.961735 32534 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:41.963954 32534 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:41.964726 32534 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.965636 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:41.961830 32249 consensus_queue.cc:1046] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 15:10:41.949607 32519 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.939646 32516 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:41.943970 29450 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:10:41.972796 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 46480.6us
I20260807 15:10:41.982008 30310 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260807 15:10:41.979861 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 54020.1us
W20260807 15:10:41.986732 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 109395us
I20260807 15:10:41.988047 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:41.951754 32452 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:41.949718 32501 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:41.980755 32420 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:42.000859 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:42.005136 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:42.005820 29644 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:42.006199 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:42.006440 29647 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 15:10:42.006723 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:42.008173 29637 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:42.002216 32532 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.003686 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:42.013270 29643 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:41.994521 32516 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:41.983697 32461 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:41.987501 32356 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Stepping down as leader of term 6
W20260807 15:10:42.016819 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 68925.3us
I20260807 15:10:42.016875 32356 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:42.017526 29638 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:42.018036 32356 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.018437 29449 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:42.027765 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:42.028575 30310 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 1.
W20260807 15:10:42.028715 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 84867us
I20260807 15:10:42.029467 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:42.031080 30274 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:42.038349 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:42.042373 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 54471.4us
I20260807 15:10:42.008402 32534 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:42.050113 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:42.050689 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:42.051174 29609 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:42.060426 29450 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:42.091495 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:42.094023 29645 raft_consensus.cc:1226] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:42.096505 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:42.041915 32493 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:10:42.099239 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:42.100215 29646 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:42.046468 32249 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.099285 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:42.046975 32461 raft_consensus.cc:686] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:42.064173 32356 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:42.038535 32497 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260807 15:10:42.115192 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:42.116082 29486 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:42.112588 29531 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:42.117679 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:42.091663 32387 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.096077 32534 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:42.118516 29609 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:42.126319 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:42.041688 32253 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260807 15:10:42.127573 29609 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:42.128633 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:42.130983 29643 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:42.131886 29642 raft_consensus.cc:1226] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 15:10:42.132007 32495 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:42.132447 32495 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:42.132807 32495 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:42.136037 32512 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:42.106590 32420 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:42.137698 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:42.139617 29449 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:42.160375 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 115634us
I20260807 15:10:42.160411 29609 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:42.162813 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:42.097348 32266 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260807 15:10:42.205487 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:42.141263 32312 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:42.207792 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:42.208031 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 47731.7us
I20260807 15:10:42.236811 29533 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:42.117321 32446 consensus_queue.cc:1046] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260807 15:10:42.205869 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 93366.8us
I20260807 15:10:42.153141 32387 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:42.151955 32530 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:42.145632 32516 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:42.234045 32512 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:42.246521 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:42.249747 29609 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:42.244391 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 145719us
I20260807 15:10:42.244200 32420 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.257083 32502 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.257861 32461 consensus_queue.cc:237] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.260735 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:42.261207 30309 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:42.261581 29483 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 5: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:42.252662 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:42.263357 30273 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:42.263440 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:42.256927 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:42.256569 32554 raft_consensus.cc:979] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:42.251816 29566 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 7
I20260807 15:10:42.266023 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:42.266711 29483 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:42.267659 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:42.269495 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:42.274379 32506 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.274902 30304 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:42.275033 32525 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:42.275676 32525 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.274684 32535 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
I20260807 15:10:42.277137 32519 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:42.284085 32552 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:42.266436 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:42.285378 29488 raft_consensus.cc:1226] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:42.286465 30273 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:42.316759 30273 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:42.248472 32387 raft_consensus.cc:686] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:42.284497 32503 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:42.288264 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:42.283540 32502 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:42.255362 32532 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:42.295878 32523 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.296383 32496 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:42.320971 29643 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:42.298519 32414 raft_consensus.cc:3032] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
W20260807 15:10:42.299196 32558 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.186s user 0.000s sys 0.000s
I20260807 15:10:42.299527 32447 raft_consensus.cc:3032] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:42.293254 32508 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:42.301512 32509 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:42.301649 32556 log.cc:924] Time spent T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260807 15:10:42.347242 32543 consensus_queue.cc:1046] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 15:10:42.350625 32543 raft_consensus.cc:3032] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:42.350984 32543 raft_consensus.cc:729] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:42.351774 32543 consensus_queue.cc:260] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.352306 32495 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.353199 32543 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:42.354295 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:42.356173 29486 raft_consensus.cc:2354] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5.
I20260807 15:10:42.299620 32557 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 15:10:42.309234 32553 log.cc:924] Time spent T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.312s user 0.002s sys 0.000s
I20260807 15:10:42.311458 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:42.272415 32312 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.287577 32554 raft_consensus.cc:1067] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:42.336923 29531 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:42.338613 29533 leader_election.cc:398] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7.
I20260807 15:10:42.246282 32530 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.335718 32447 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
W20260807 15:10:42.369416 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 58086.1us
I20260807 15:10:42.367879 29566 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:42.347160 32526 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:42.348321 32509 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:42.329550 32414 raft_consensus.cc:729] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:42.347395 32508 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.386656 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:42.361955 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 299553us
I20260807 15:10:42.326836 32493 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 15:10:42.366283 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 305963us
I20260807 15:10:42.367937 29533 leader_election.cc:401] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:10:42.372318 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:42.348809 32500 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:42.376709 32496 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:42.377907 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:42.408658 29647 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:42.378428 32495 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:42.326767 32502 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.326256 32387 consensus_queue.cc:237] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.413926 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:42.416610 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:42.379422 29641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2352) took 1250 ms (client timeout 1633 ms). Trace:
I20260807 15:10:42.387053 32312 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:42.381178 32530 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:42.384944 32447 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.423031 32447 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:42.393464 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 54955.9us
I20260807 15:10:42.415213 30311 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 15:10:42.400058 32479 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:42.323220 32503 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.401271 32532 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7.
I20260807 15:10:42.403858 32511 raft_consensus.cc:3032] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:42.454666 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:42.412894 29450 leader_election.cc:398] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:42.457496 29450 leader_election.cc:401] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260807 15:10:42.457684 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:42.413676 32496 raft_consensus.cc:686] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:42.362397 32557 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:42.421481 29641 rpcz_store.cc:269] 0807 15:10:41.129320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:41.129456 (+ 136us) service_pool.cc:227] Handling call
0807 15:10:42.379164 (+1249708us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540031f954. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:42.379327 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1725004032}
I20260807 15:10:42.414323 29488 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d87368aeb34548079f36255279bee400"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:44106
I20260807 15:10:42.421145 29479 raft_consensus.cc:2379] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 3: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:42.431016 29647 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:42.363951 32525 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:42.432626 29481 raft_consensus.cc:1261] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:10:42.434423 29533 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:42.494729 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 60497.1us
I20260807 15:10:42.497462 29609 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:42.468034 29564 raft_consensus.cc:2396] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260807 15:10:42.499759 29563 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:42.414878 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:42.508975 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:42.477193 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 155153us
I20260807 15:10:42.490175 29488 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:42.510637 29488 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:42.418797 32508 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:42.503661 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:42.515826 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:42.517357 29533 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:42.475060 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 83445.5us
I20260807 15:10:42.499609 29449 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:42.438558 32511 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:42.530194 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:42.490880 29452 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:42.534514 29481 raft_consensus.cc:1226] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:42.500509 32557 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:42.553612 29480 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:42.509284 32512 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.438720 32549 consensus_queue.cc:1046] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260807 15:10:42.512588 32535 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:42.559574 32494 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:42.517066 32335 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:42.531497 32501 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:42.591074 29450 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:10:42.578632 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 101061us
I20260807 15:10:42.569762 29609 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:42.540763 32554 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:42.416615 32414 consensus_queue.cc:260] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.415627 32500 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.435672 32479 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.566182 29482 raft_consensus.cc:1226] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
W20260807 15:10:42.595553 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 57066.7us
W20260807 15:10:42.610617 29365 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 1177fe2445db43e2b8366f33a841a041 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4b092f7f951b4137b5d7810056684270 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:42.589321 32385 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:42.619699 29561 raft_consensus.cc:1261] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 15:10:42.617414 29487 raft_consensus.cc:1261] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 15:10:42.598429 32530 raft_consensus.cc:2726] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:42.618310 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:42.605795 32531 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:42.639827 29481 raft_consensus.cc:2379] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:42.640055 29452 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:42.609347 32411 consensus_queue.cc:1035] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260807 15:10:42.648739 32550 consensus_queue.cc:1046] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
W20260807 15:10:42.649207 32578 log.cc:924] Time spent T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.085s user 0.000s sys 0.001s
I20260807 15:10:42.603730 32566 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:42.614756 32494 raft_consensus.cc:686] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:42.591930 32335 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.617949 32507 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
I20260807 15:10:42.600847 32496 consensus_queue.cc:237] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.615087 32511 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:42.646751 32502 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:42.657133 32461 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:42.664356 32548 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:43.194065 32580 log.cc:924] Time spent T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.154s user 0.000s sys 0.000s
I20260807 15:10:43.193693 32461 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.194772 32500 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.194011 32548 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.642306 32362 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.553s
W20260807 15:10:42.667771 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 47065.8us
W20260807 15:10:42.792799 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 140097us
I20260807 15:10:42.726433 32532 consensus_queue.cc:1046] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.527s
I20260807 15:10:42.647053 32501 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:42.645386 32385 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:43.196929 32548 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:42.723824 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:43.197350 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 474377us
I20260807 15:10:42.924437 32411 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:42.752077 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:43.200093 29533 leader_election.cc:398] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5.
W20260807 15:10:43.246709 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 46402.5us
I20260807 15:10:43.242328 29561 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:42.629979 32552 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:43.253314 32511 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:43.232846 30311 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s user 0.066s sys 0.069s
I20260807 15:10:42.774559 32584 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:42.765815 32508 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.249603 30312 raft_consensus.cc:2454] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:10:42.651144 32479 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:42.791807 32293 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.351435 32508 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.352313 32293 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.353731 32508 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:43.354391 32293 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:42.765816 32408 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:10:43.355141 29488 consensus_meta.cc:287] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.837s user 0.006s sys 0.004s
I20260807 15:10:42.726291 32503 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:43.355613 29488 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:42.791944 32105 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.356523 32105 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.258287 32411 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.357494 29488 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:42.831115 32550 raft_consensus.cc:3032] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
W20260807 15:10:43.359336 30311 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.793s user 0.071s sys 0.087s
I20260807 15:10:42.722563 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:42.775288 32482 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:43.278726 32566 consensus_queue.cc:1046] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260807 15:10:43.350684 32584 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.365658 29642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35570 (request call id 566) took 1002 ms. Trace:
I20260807 15:10:43.358620 32105 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:43.369280 32411 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:43.355455 32408 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.277891 32530 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260807 15:10:43.372071 32534 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:43.372597 32534 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.373386 32495 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:43.373746 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.373907 32495 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.374688 32534 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.375258 32534 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:43.377549 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.379084 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.380511 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.371763 32408 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.366108 29642 rpcz_store.cc:276] 0807 15:10:42.363704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.363842 (+ 138us) service_pool.cc:227] Handling call
0807 15:10:42.370239 (+ 6397us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:42.429100 (+ 58861us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:42.429135 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:42.429179 (+ 44us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:42.429282 (+ 103us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:43.363267 (+933985us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b5400360954. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:43.363317 (+ 50us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:43.365593 (+ 2276us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":134886144}
W20260807 15:10:43.400866 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 180264us
I20260807 15:10:43.401885 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.240330 32501 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.362267 32550 raft_consensus.cc:729] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:43.429051 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.436466 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:43.415829 32557 consensus_meta.cc:287] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.855s user 0.006s sys 0.005s
W20260807 15:10:43.429816 32509 consensus_meta.cc:287] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.044s user 0.000s sys 0.014s
W20260807 15:10:43.443823 30274 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.912s user 0.003s sys 0.032s
W20260807 15:10:43.450974 30274 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.919s user 0.003s sys 0.032s
W20260807 15:10:43.451287 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 949447us
I20260807 15:10:43.493337 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.367066 32482 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.442940 32495 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.375782 32534 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.503211 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.454419 32461 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:43.511051 32447 consensus_meta.cc:287] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 1.088s user 0.012s sys 0.001s
I20260807 15:10:43.385761 32494 consensus_queue.cc:237] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.451421 32557 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.456670 32509 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.540752 32584 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.541760 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.548183 29563 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:43.529202 32483 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:43.527611 32595 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:43.594193 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.573032 29569 raft_consensus.cc:1226] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:43.596762 29563 raft_consensus.cc:2379] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:43.542632 32447 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:43.600662 29608 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:43.542457 32335 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:43.605269 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 147457us
I20260807 15:10:43.613942 29643 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 15:10:43.613334 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.614794 29564 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:43.615443 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.615695 30311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1087) took 1130 ms. Trace:
W20260807 15:10:43.601656 32554 consensus_meta.cc:287] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.997s user 0.011s sys 0.000s
I20260807 15:10:43.562269 32594 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.625674 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:43.629755 29641 raft_consensus.cc:3032] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:43.629891 32495 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.630132 29641 raft_consensus.cc:729] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:43.630504 29608 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:43.630621 32495 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.630986 29641 consensus_queue.cc:260] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.631793 29608 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:43.619594 32593 raft_consensus.cc:2781] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:43.632431 32593 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.632833 32593 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:43.597397 32207 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.625531 29644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59992 (request call id 2351) took 1282 ms. Trace:
I20260807 15:10:43.626664 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.633335 32503 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:43.606467 32370 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:43.604074 32542 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:43.635358 29644 rpcz_store.cc:276] 0807 15:10:42.337046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.337167 (+ 121us) service_pool.cc:227] Handling call
0807 15:10:42.365294 (+ 28127us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:42.479050 (+113756us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:42.479099 (+ 49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:42.479161 (+ 62us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:42.479229 (+ 68us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:43.619064 (+1139835us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002dbc54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:43.619116 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:43.619246 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":260967168}
I20260807 15:10:43.633023 32495 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.509480 32550 consensus_queue.cc:260] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.622475 32310 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.633180 32508 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:43.634394 32554 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:43.669472 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.642735 32293 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.616627 32447 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.604984 32595 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.633581 32207 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.647428 32589 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:43.655000 32501 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.619598 30311 rpcz_store.cc:276] 0807 15:10:42.480924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.481112 (+ 188us) service_pool.cc:227] Handling call
0807 15:10:42.529059 (+ 47947us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:42.529280 (+ 221us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 15:10:43.360917 (+831637us) log.cc:842] Serialized 14 byte log entry
0807 15:10:43.611007 (+250090us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:43.611058 (+ 51us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:43.611103 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:43.611163 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:43.611265 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":920319,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":2314,"thread_start_us":1041725,"threads_started":2}
I20260807 15:10:43.598691 32483 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.666963 32508 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.684216 32293 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.666303 32310 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.665422 32495 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:43.653679 32601 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.685177 29570 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:43.699959 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.719326 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:43.702103 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 49732.5us
I20260807 15:10:43.713547 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:43.714709 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.715013 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.703668 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:43.722481 29566 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:43.726043 29638 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:10:43.726567 29564 raft_consensus.cc:2379] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:43.701001 32591 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:43.704730 32508 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:43.731144 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.727857 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:43.733832 29560 raft_consensus.cc:1261] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:43.734853 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.736241 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.736814 32207 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.738358 32523 raft_consensus.cc:3032] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:43.739174 32293 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.739574 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2155) took 1484 ms. Trace:
I20260807 15:10:43.710495 32602 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.740927 32310 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.768539 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.730991 32604 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:43.716012 32495 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.749998 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:43.659032 32370 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.704401 32511 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.658432 32542 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.719446 32601 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:43.768968 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 45562.9us
I20260807 15:10:43.790751 29608 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:43.752046 32557 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:43.741158 29645 raft_consensus.cc:1226] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:43.772732 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:43.744187 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.778508 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:43.779227 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 134818us
I20260807 15:10:43.697464 32589 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.767493 29482 rpcz_store.cc:276] 0807 15:10:42.255150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.262357 (+ 7207us) service_pool.cc:227] Handling call
0807 15:10:42.296994 (+ 34637us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:42.616280 (+319286us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:43.739312 (+1123032us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54001b5154. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:43.739509 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":587888000}
I20260807 15:10:43.749922 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.787462 29566 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 15:10:43.747293 32411 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:43.773854 32596 log.cc:924] Time spent T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.227s user 0.001s sys 0.001s
I20260807 15:10:43.789805 29567 raft_consensus.cc:1226] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:43.789921 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.791783 29479 raft_consensus.cc:1261] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:43.768566 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.750030 32523 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:43.745108 32509 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.794879 29560 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:43.650945 32594 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.802737 32611 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:43.791224 32534 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.810596 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.812041 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:43.814872 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:43.813488 29487 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:43.781716 32604 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.805719 32335 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:43.823999 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:43.806768 32293 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:43.825234 29608 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:43.805919 32496 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.750828 32591 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:43.809191 32557 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.825971 32293 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.812779 32548 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.799145 32482 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.838742 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.773671 32602 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.843130 29645 raft_consensus.cc:1261] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:43.835250 32207 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:43.796962 32511 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.845683 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.805526 32411 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.832464 32497 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:43.815995 32461 consensus_queue.cc:1046] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260807 15:10:43.833724 32554 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:43.850507 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.845849 32494 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:43.838549 32293 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:43.839108 32447 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.861794 29563 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:43.861163 29643 raft_consensus.cc:1261] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:43.868623 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.846613 32207 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:43.834769 32310 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260807 15:10:43.832516 32496 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.884181 32463 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:43.882150 32601 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.882742 32542 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.883111 32495 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.844159 32548 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.835752 32335 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.887761 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.903307 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.891701 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.893287 29487 raft_consensus.cc:1226] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:43.903501 29479 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:43.904381 29481 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:10:43.820536 32614 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260807 15:10:43.908195 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:43.857906 32534 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 15:10:43.841324 32557 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.905920 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:43.873735 32207 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:43.910868 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:43.841468 32523 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.833865 32611 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.916246 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:43.858806 32497 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.919872 32495 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:43.863219 32494 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:43.921316 32606 log.cc:924] Time spent T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.102s user 0.001s sys 0.000s
W20260807 15:10:43.921401 32615 log.cc:924] Time spent T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.097s user 0.001s sys 0.000s
I20260807 15:10:43.920735 32604 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.885390 32493 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:43.931252 32548 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.931469 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:43.932169 32603 log.cc:924] Time spent T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.140s user 0.001s sys 0.001s
I20260807 15:10:43.889065 32483 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:43.884847 32463 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.943975 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:44.664295 32493 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:44.664858 29560 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:43.951643 32496 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:43.923318 32542 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:44.063342 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 161196us
I20260807 15:10:43.956431 29564 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:44.684454 32598 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:44.685091 32598 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:44.685902 32626 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:44.686523 32626 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.957720 32511 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:44.106360 32602 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:44.001384 32607 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:44.687974 32405 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:44.688446 32607 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:44.689033 32607 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:44.235944 29646 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260807 15:10:43.957525 32613 log.cc:924] Time spent T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.150s user 0.001s sys 0.000s
I20260807 15:10:43.993263 32338 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:44.212889 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2713) took 1883 ms. Trace:
I20260807 15:10:43.946796 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:44.693794 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.693439 29569 rpcz_store.cc:276] 0807 15:10:42.328985 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.329153 (+ 168us) service_pool.cc:227] Handling call
0807 15:10:42.329483 (+ 330us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:43.598991 (+1269508us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:44.212612 (+613621us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002cecd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:44.212816 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2859375360}
I20260807 15:10:44.669665 32335 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:44.667248 32493 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:44.673684 32523 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:44.653751 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:44.653216 29647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2380) took 1035 ms. Trace:
I20260807 15:10:44.244673 32529 raft_consensus.cc:3032] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:44.218031 32497 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:44.688720 32405 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:44.691586 29566 raft_consensus.cc:1261] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 15:10:44.712096 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:44.248627 29638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59992 (request call id 2339) took 2188 ms (client timeout 2048 ms). Trace:
I20260807 15:10:44.656503 32526 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:44.575495 32611 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:44.656652 32508 consensus_meta.cc:287] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.885s user 0.011s sys 0.001s
W20260807 15:10:44.654851 32593 consensus_meta.cc:287] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 1.022s user 0.006s sys 0.008s
W20260807 15:10:44.360885 32503 consensus_meta.cc:287] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.705s user 0.011s sys 0.002s
I20260807 15:10:43.933802 32601 consensus_queue.cc:1046] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.780s
I20260807 15:10:44.698966 32542 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:43.917164 32595 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:44.100972 32370 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:44.703696 29647 rpcz_store.cc:276] 0807 15:10:43.617816 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.617966 (+ 150us) service_pool.cc:227] Handling call
0807 15:10:43.643228 (+ 25262us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:43.728678 (+ 85450us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:43.728721 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:43.728776 (+ 55us) raft_consensus.cc:1631] Marking committed up to 11
0807 15:10:43.728835 (+ 59us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:44.652850 (+924015us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b54003516d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:44.652919 (+ 69us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:44.653125 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":195867904}
I20260807 15:10:44.710342 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.713680 32335 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:44.695366 32293 consensus_meta.cc:287] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.791s user 0.011s sys 0.000s
W20260807 15:10:44.696242 29531 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.847s user 0.003s sys 0.023s
I20260807 15:10:43.993346 32589 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:44.712924 29638 rpcz_store.cc:269] 0807 15:10:42.047508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.047661 (+ 153us) service_pool.cc:227] Handling call
0807 15:10:44.235157 (+2187496us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001bf8d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:44.235300 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2691391488}
I20260807 15:10:44.002403 32594 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:44.716369 29450 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:44.719635 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:44.701292 32604 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:44.705494 32493 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:43.936371 32495 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:44.324694 32207 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:44.734438 29480 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:44.001178 32591 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:44.736063 32622 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
W20260807 15:10:44.736155 30312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48588 (request call id 760) took 1987 ms (client timeout 1521 ms). Trace:
I20260807 15:10:44.736605 32582 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:44.736802 32405 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:44.700389 32338 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:44.710332 32529 raft_consensus.cc:729] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
W20260807 15:10:44.738993 29531 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.890s user 0.003s sys 0.023s
I20260807 15:10:44.739811 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.720633 32483 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:44.745298 30309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 761) took 1532 ms. Trace:
I20260807 15:10:44.733418 32503 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:44.748651 30312 rpcz_store.cc:269] 0807 15:10:42.749266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.751624 (+ 2358us) service_pool.cc:227] Handling call
0807 15:10:44.735919 (+1984295us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b540061f654. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:44.736059 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8703360}
I20260807 15:10:44.750216 32493 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:44.744218 32370 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:44.747411 29610 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.592s user 0.001s sys 0.013s
I20260807 15:10:44.756330 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:44.756400 29640 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:44.757637 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.759475 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.759836 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.729241 32508 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:44.741032 32623 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:44.757720 32635 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:44.816512 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 100266us
I20260807 15:10:44.976392 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:45.000056 29610 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.870s user 0.004s sys 0.020s
I20260807 15:10:44.746551 32557 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:44.981736 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.718398 32526 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:44.858523 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:44.813558 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:45.022256 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 208878us
I20260807 15:10:44.768290 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:45.023432 29638 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:44.743533 32293 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.024068 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:44.998337 29479 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:44.754570 32405 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:44.757884 32319 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:44.755993 32338 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.000937 29480 raft_consensus.cc:2379] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 2: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:44.987972 30309 rpcz_store.cc:276] 0807 15:10:43.213447 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:44.734754 (+1521307us) service_pool.cc:227] Handling call
0807 15:10:44.744744 (+ 9990us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:44.744914 (+ 170us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:44.744941 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:44.744982 (+ 41us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:44.745013 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:44.745075 (+ 62us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:44.745222 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:44.731509 32593 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:44.999579 29485 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:44.751363 32624 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:44.750680 32594 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:45.022017 30308 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 1.
I20260807 15:10:45.028108 32591 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:45.028761 32611 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:45.030876 32557 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:44.997160 29531 connection.cc:232] RPC call timeout handler was delayed by -1.1294825839577243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260807 15:10:45.000466 29450 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:45.050071 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.754357 32207 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.087172 29479 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:45.052841 30312 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:44.756625 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:44.804046 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.017819 32626 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.059943 29642 raft_consensus.cc:1226] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:45.060148 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:45.098637 29561 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:45.098886 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.065980 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:44.742583 32335 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.046075 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.079797 29644 raft_consensus.cc:1226] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:45.055594 32621 raft_consensus.cc:2781] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:45.101416 29479 raft_consensus.cc:1226] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:45.082967 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.121927 32543 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:45.055366 32564 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:45.111696 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 111323us
W20260807 15:10:45.121433 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 84805.7us
I20260807 15:10:45.105309 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.125938 30312 raft_consensus.cc:2379] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:45.060985 32338 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:45.086974 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:44.747066 32604 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.093101 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.006577 32483 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.101665 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.133500 32614 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:45.078284 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:45.103133 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:45.080363 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 270671us
I20260807 15:10:45.013459 32370 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:44.753991 32582 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.141038 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:45.152642 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.164243 29642 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:45.060737 32405 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:45.167073 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.088972 32633 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:45.175590 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.054672 32319 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:45.175807 29563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2104) took 1450 ms (client timeout 1900 ms). Trace:
I20260807 15:10:45.176622 30311 raft_consensus.cc:2396] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260807 15:10:45.177945 29563 rpcz_store.cc:269] 0807 15:10:43.713764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.714358 (+ 594us) service_pool.cc:227] Handling call
0807 15:10:45.164129 (+1449771us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540022cc54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:45.164247 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":324093696}
I20260807 15:10:45.122855 32420 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:45.014348 32623 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.123401 32601 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:45.025519 32635 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.122546 32543 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.134541 32638 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:45.122623 30303 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:10:45.097417 32557 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.092394 32611 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.149382 32532 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:45.192485 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 162512us
I20260807 15:10:45.086082 32591 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:45.084581 32594 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.139958 32621 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:45.199175 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:45.212832 29642 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:45.072736 32624 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.186924 30304 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:45.203840 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.208369 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.176478 32632 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:45.208631 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 47640.1us
I20260807 15:10:45.169940 32508 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.159703 32338 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.228497 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:45.180760 32628 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:45.199311 32542 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.157785 32614 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
W20260807 15:10:45.220006 29570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2723) took 1717 ms (client timeout 1635 ms). Trace:
W20260807 15:10:45.240944 29570 rpcz_store.cc:269] 0807 15:10:43.502136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.502920 (+ 784us) service_pool.cc:227] Handling call
0807 15:10:45.219777 (+1716857us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002940d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:45.219930 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":407732480}
I20260807 15:10:45.224793 29450 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:45.236476 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:45.245585 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:45.246696 29642 raft_consensus.cc:2379] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 3: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:45.191766 32420 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.180516 32405 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } attrs { replace: true } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.142282 32529 consensus_queue.cc:260] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.222977 32207 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:45.249831 29450 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:45.201223 32601 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.264873 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:45.252456 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:45.215813 32532 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.209949 32356 consensus_queue.cc:1035] T afaa655e923f4aecbeee1b026c46810e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260807 15:10:45.205847 32638 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.217451 32642 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:45.222348 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:45.276698 32611 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.232779 32495 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.214951 32621 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:45.262125 32627 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:45.268208 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 48957us
I20260807 15:10:45.268622 32640 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:45.262737 32493 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.177131 32564 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.252293 32628 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:45.270833 32516 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:45.299571 29646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35570 (request call id 563) took 3151 ms. Trace:
I20260807 15:10:45.180742 32633 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.218614 32648 consensus_queue.cc:1046] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260807 15:10:45.292598 32319 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.289309 32335 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.272032 32593 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.271744 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.296504 32526 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.277596 32604 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.310135 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:45.324338 30308 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:45.311875 29642 raft_consensus.cc:1226] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:45.310792 32638 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.309700 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.305791 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.300027 29646 rpcz_store.cc:276] 0807 15:10:42.138850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.140422 (+ 1572us) service_pool.cc:227] Handling call
0807 15:10:44.235616 (+2095194us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:44.690775 (+455159us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:45.289679 (+598904us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b54001bf8d0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:45.289889 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4791343488}
I20260807 15:10:45.320411 29643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59992 (request call id 2362) took 1599 ms. Trace:
I20260807 15:10:45.301158 30311 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:45.303052 32635 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.302147 32623 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.343529 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.338899 29643 rpcz_store.cc:276] 0807 15:10:43.721278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.721391 (+ 113us) service_pool.cc:227] Handling call
0807 15:10:43.721642 (+ 251us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:43.862383 (+140741us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:45.320100 (+1457717us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003c7b54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:45.320341 (+ 241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":319978752}
I20260807 15:10:45.345608 29643 raft_consensus.cc:1226] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:45.270144 32207 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.304036 32338 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.276979 32642 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.296273 32600 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:45.350701 29452 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:45.296962 32493 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:45.350594 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.299867 32591 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.318648 32582 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.253325 32632 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.302253 32614 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:10:45.356220 32338 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:45.312826 32648 raft_consensus.cc:3032] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:45.302517 32601 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.304286 32370 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.308760 32557 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.293236 32495 consensus_queue.cc:1046] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260807 15:10:45.372504 32420 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.368760 32648 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:45.301348 32532 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.301844 32633 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:45.347609 32607 consensus_meta.cc:287] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.658s user 0.012s sys 0.000s
I20260807 15:10:45.371271 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.362834 29609 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:45.301313 32564 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.374531 32338 raft_consensus.cc:3032] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:45.382731 32338 raft_consensus.cc:729] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:10:45.384577 32523 consensus_meta.cc:287] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.673s user 0.008s sys 0.004s
I20260807 15:10:45.384842 32338 consensus_queue.cc:260] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.364369 32493 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.389235 32493 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.392447 32207 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.320281 32629 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260807 15:10:45.308034 32627 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.369490 32614 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:45.372624 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.380072 32543 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.372596 32609 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:45.368731 32600 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.374130 32648 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.476135 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.415464 32624 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.457973 32405 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.485829 29452 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:45.487133 32604 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:45.487933 32604 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.491859 32604 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.495219 32494 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.500214 32627 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.437129 32632 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.523427 32616 raft_consensus.cc:3032] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:45.535697 30310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1091) took 2736 ms. Trace:
I20260807 15:10:45.541131 32609 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:45.534825 29488 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.199s user 0.017s sys 0.011s
I20260807 15:10:45.524423 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.547544 30310 rpcz_store.cc:276] 0807 15:10:42.799698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:44.396902 (+1597204us) service_pool.cc:227] Handling call
0807 15:10:44.736658 (+339756us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:44.736883 (+ 225us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:44.736912 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:44.736959 (+ 47us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:44.736992 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:44.737050 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:45.535371 (+798321us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540061f650. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:45.535591 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":780232576}
I20260807 15:10:45.514420 32463 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.551823 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.502753 30303 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:45.553236 30310 raft_consensus.cc:1799] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Handling vote request from an unknown peer 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:45.557576 30310 raft_consensus.cc:2379] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:45.501426 32627 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:10:45.549446 29488 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.214s user 0.017s sys 0.011s
I20260807 15:10:45.535856 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:45.569476 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 206851us
I20260807 15:10:45.572168 32616 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:45.572932 29452 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:45.573951 32288 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:45.559593 30306 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:45.574657 32288 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:45.584257 32288 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:45.575078 32312 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:45.585923 29452 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:45.441005 32642 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.584781 29644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2385) took 1619 ms. Trace:
I20260807 15:10:45.460186 32483 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.588990 29644 rpcz_store.cc:276] 0807 15:10:43.965600 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.965768 (+ 168us) service_pool.cc:227] Handling call
0807 15:10:43.966157 (+ 389us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:45.123018 (+1156861us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:45.584506 (+461488us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400360e54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:45.584711 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2537133440}
I20260807 15:10:45.575278 32550 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:45.570967 29609 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:45.597549 29609 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:45.649430 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.650514 29481 raft_consensus.cc:2379] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 3: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:45.416314 32614 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.593545 32648 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:45.640997 32329 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:45.661150 32329 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:45.662132 32329 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:45.646193 32600 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.640674 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.665172 30305 raft_consensus.cc:2379] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 7: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:45.573642 32616 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:45.669951 32616 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:45.670099 29640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2384) took 1794 ms (client timeout 2157 ms). Trace:
I20260807 15:10:45.654139 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.654968 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.671633 29485 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:45.655771 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.672816 29483 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:45.656618 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.636487 32414 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:45.670534 29640 rpcz_store.cc:269] 0807 15:10:43.876028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.876188 (+ 160us) service_pool.cc:227] Handling call
0807 15:10:45.669912 (+1793724us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54002ed6d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:45.670025 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1959312640}
I20260807 15:10:45.644178 32611 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:45.653297 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:45.667665 32639 log.cc:924] Time spent T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.589s user 0.005s sys 0.000s
I20260807 15:10:45.478775 32607 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.683236 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.684139 29487 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:45.688915 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.690882 29480 raft_consensus.cc:1226] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:45.694101 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.669148 32614 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.701776 32609 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:45.758486 32632 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:45.765596 29609 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:45.759451 32632 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:45.768934 32411 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:45.779699 29609 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:45.781257 29609 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:45.782292 32312 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:45.783099 32312 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:45.784221 32312 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:45.785586 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:45.789731 32293 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:45.791723 32500 raft_consensus.cc:3032] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:45.792505 32500 raft_consensus.cc:729] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:45.794281 32500 consensus_queue.cc:260] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:45.831699 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 49017.4us
I20260807 15:10:45.836444 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:45.802008 29378 catalog_manager.cc:5495] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 7 to 8, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 8 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:45.864286 32654 consensus_queue.cc:1046] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260807 15:10:45.861130 32611 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:45.861419 32554 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:45.909992 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2119) took 2172 ms. Trace:
I20260807 15:10:45.910543 29566 rpcz_store.cc:276] 0807 15:10:43.737405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.805806 (+ 68401us) service_pool.cc:227] Handling call
0807 15:10:44.691271 (+885465us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:44.712126 (+ 20855us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:45.909652 (+1197526us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400242050. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:45.909821 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2035579776}
W20260807 15:10:45.913350 30308 consensus_meta.cc:287] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.573s user 0.017s sys 0.017s
I20260807 15:10:45.915303 30308 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:45.921330 29452 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:10:45.948690 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 60877.9us
I20260807 15:10:45.958698 29641 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:45.972653 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:45.982604 32607 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:45.985287 29482 consensus_meta.cc:287] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.708s user 0.012s sys 0.020s
I20260807 15:10:45.985576 29641 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:45.985874 29482 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
W20260807 15:10:45.986567 29641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2373) took 2378 ms (client timeout 1978 ms). Trace:
W20260807 15:10:45.987190 29641 rpcz_store.cc:269] 0807 15:10:43.607955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.608121 (+ 166us) service_pool.cc:227] Handling call
0807 15:10:45.375496 (+1767375us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b18001fefc0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdff856 00007f94dbd51f7e 00007f94dbdbb367 00007f94dbdbcb4e 00007f94dbdc8228 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c
0807 15:10:45.799296 (+423800us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b58002042b0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd3ff63 00007f94dbda3aba 00007f94dbdbb3af 00007f94dbdbcb4e 00007f94dbdc8228 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c
0807 15:10:45.945684 (+146388us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b58001103b0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd3ff63 00007f94dbda3aba 00007f94dbdbb3af 00007f94dbdbcb4e 00007f94dbdc8228 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c
0807 15:10:45.986404 (+ 40720us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1087977856}
I20260807 15:10:45.988349 32494 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:10:45.912578 32611 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:45.912629 32554 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:45.883507 32288 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:46.017242 32621 consensus_meta.cc:287] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.720s user 0.019s sys 0.009s
I20260807 15:10:46.019016 32621 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.024508 32582 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:46.024837 32632 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.026011 32594 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.016724 32554 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:46.028735 32621 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.003914 32598 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:46.017534 32611 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:46.025507 32582 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.052202 29484 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:46.071630 29564 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
W20260807 15:10:46.082456 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 161094us
I20260807 15:10:46.084790 32288 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.085243 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:46.092293 32310 raft_consensus.cc:2781] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:46.094074 32310 raft_consensus.cc:686] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:46.096153 32310 consensus_queue.cc:237] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.100238 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:46.110013 30308 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:46.120419 29452 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:46.137759 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2740) took 1430 ms. Trace:
I20260807 15:10:46.160790 29564 rpcz_store.cc:276] 0807 15:10:44.706960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:44.711796 (+ 4836us) service_pool.cc:227] Handling call
0807 15:10:46.137507 (+1425711us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540031b0d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:46.137669 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3124930944}
I20260807 15:10:46.146960 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:46.127668 32500 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:46.149246 29647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2387) took 1381 ms. Trace:
I20260807 15:10:46.146529 32594 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:46.179610 29647 rpcz_store.cc:276] 0807 15:10:44.768268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:44.768524 (+ 256us) service_pool.cc:227] Handling call
0807 15:10:44.981285 (+212761us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:45.210302 (+229017us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:45.210336 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:45.210366 (+ 30us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:45.210385 (+ 19us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:46.148933 (+938548us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000eecd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:46.148996 (+ 63us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:46.149165 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":526117632}
I20260807 15:10:46.178524 29378 catalog_manager.cc:5495] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:46.194676 32529 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:46.139799 32312 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:46.218389 32627 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:46.218966 32582 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.219460 32627 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.221510 32312 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:46.223330 32616 consensus_meta.cc:287] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.553s user 0.009s sys 0.017s
I20260807 15:10:46.226632 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:46.226818 32627 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.227391 32612 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:46.225742 29378 catalog_manager.cc:5495] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:46.183187 32494 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:46.209877 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:46.225150 32594 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:10:46.238484 32414 consensus_meta.cc:287] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.561s user 0.014s sys 0.014s
I20260807 15:10:46.243659 32494 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:10:46.255012 30272 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.517s user 0.010s sys 0.081s
I20260807 15:10:46.249282 29378 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 6 to 7, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 7 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:46.228273 32612 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.244727 32312 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 15:10:46.262698 30272 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.525s user 0.011s sys 0.081s
W20260807 15:10:46.265522 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 1.52739e+06us
I20260807 15:10:46.264322 29378 catalog_manager.cc:5495] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:10:46.268522 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.271958 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.272855 29644 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:46.275456 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:46.262202 32329 consensus_meta.cc:287] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.599s user 0.012s sys 0.017s
I20260807 15:10:46.264153 32595 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:46.294699 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.288384 29379 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48690 (request call id 387) took 5702 ms. Trace:
I20260807 15:10:46.297130 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.265941 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:46.266614 32312 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:46.286034 32632 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:46.302786 29608 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.097s user 0.027s sys 0.045s
W20260807 15:10:46.305981 29608 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.101s user 0.027s sys 0.045s
W20260807 15:10:46.307495 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 1.1024e+06us
W20260807 15:10:46.298795 32648 consensus_meta.cc:287] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.639s user 0.017s sys 0.008s
W20260807 15:10:46.313238 29609 leader_election.cc:334] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Timed out: RequestConsensusVote RPC to 127.27.144.196:43545 timed out after 1.521s (SENT)
W20260807 15:10:46.320087 30273 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.162s user 0.018s sys 0.038s
I20260807 15:10:46.305186 29482 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:46.303474 32312 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:46.408170 29531 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.267s user 0.024s sys 0.054s
I20260807 15:10:46.286034 32595 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:46.465705 29610 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.270s user 0.010s sys 0.039s
I20260807 15:10:46.286329 32329 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.319360 32650 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
W20260807 15:10:46.496097 29645 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.267s user 0.015s sys 0.057s
W20260807 15:10:46.525508 30273 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.367s user 0.018s sys 0.039s
W20260807 15:10:46.524982 30303 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s user 0.006s sys 0.029s
I20260807 15:10:46.525872 29609 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:46.557191 30272 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:46.529830 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:46.527805 29610 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.362s user 0.010s sys 0.039s
W20260807 15:10:46.526019 29488 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.889s user 0.008s sys 0.006s
W20260807 15:10:46.616674 29488 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.024s user 0.008s sys 0.006s
W20260807 15:10:46.616999 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 59972.8us
W20260807 15:10:46.612885 29645 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.384s user 0.015s sys 0.063s
W20260807 15:10:46.525933 29531 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.385s user 0.024s sys 0.054s
W20260807 15:10:46.612900 30273 connection.cc:232] RPC call timeout handler was delayed by -2.2742394200176932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260807 15:10:46.618906 30273 connection.cc:232] RPC call timeout handler was delayed by -1.7541398339672014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260807 15:10:46.314456 32632 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:46.619545 30273 connection.cc:232] RPC call timeout handler was delayed by -1.6599008420016617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260807 15:10:46.620976 30273 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:46.623543 30273 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:46.625283 30273 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:46.629597 29646 raft_consensus.cc:1226] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:46.630259 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:46.605276 30303 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s user 0.007s sys 0.030s
I20260807 15:10:46.632396 30272 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:46.633544 29469 tablet_service.cc:1514] Processing DeleteTablet for tablet 748d0394657643cfbf71e2bac60ff2f2 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33668
I20260807 15:10:46.628903 32414 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:46.633105 32602 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:46.644347 32414 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.644373 32602 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.647171 32602 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.647183 32414 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.648698 32105 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:46.649299 32105 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:46.651218 32105 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:46.651973 30307 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.033s user 0.019s sys 0.029s
W20260807 15:10:46.652330 30307 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.384s user 0.019s sys 0.029s
I20260807 15:10:46.652946 30307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 616) took 1681 ms. Trace:
W20260807 15:10:46.654158 32554 consensus_meta.cc:287] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.625s user 0.010s sys 0.001s
I20260807 15:10:46.653249 30307 rpcz_store.cc:276] 0807 15:10:44.971820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:44.972067 (+ 247us) service_pool.cc:227] Handling call
0807 15:10:44.972568 (+ 501us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:44.972865 (+ 297us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 15:10:45.024985 (+ 52120us) log.cc:842] Serialized 14 byte log entry
0807 15:10:46.652617 (+1627632us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:46.652669 (+ 52us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:10:46.652716 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:46.652788 (+ 72us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:46.652894 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":103516,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":77476,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":1676552,"threads_started":3,"wal-append.queue_time_us":1254052}
I20260807 15:10:46.299119 29379 rpcz_store.cc:276] 0807 15:10:40.585778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:40.597323 (+ 11545us) service_pool.cc:227] Handling call
0807 15:10:46.288295 (+5690972us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:41.805893 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:41.806639 (+ 746us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:41.806705 (+ 66us) write_op.cc:435] Acquired schema lock
0807 15:10:41.806726 (+ 21us) tablet.cc:660] Decoding operations
0807 15:10:41.928796 (+122070us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:41.928990 (+ 194us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:41.929022 (+ 32us) tablet.cc:683] Acquiring locks for 10 operations
0807 15:10:41.929945 (+ 923us) tablet.cc:699] Row locks acquired
0807 15:10:41.929987 (+ 42us) write_op.cc:260] PREPARE: finished
0807 15:10:41.930177 (+ 190us) write_op.cc:270] Start()
0807 15:10:41.930331 (+ 154us) write_op.cc:276] Timestamp: P: 1786115441930105 usec, L: 0
0807 15:10:41.930350 (+ 19us) op_driver.cc:331] REPLICATION: starting
0807 15:10:41.931109 (+ 759us) log.cc:842] Serialized 4108 byte log entry
0807 15:10:42.567637 (+636528us) op_driver.cc:444] REPLICATION: finished
0807 15:10:43.441134 (+873497us) write_op.cc:301] APPLY: starting
0807 15:10:43.445604 (+ 4470us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:43.523014 (+ 77410us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:43.536578 (+ 13564us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:43.837887 (+301309us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:43.868305 (+ 30418us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0807 15:10:43.873036 (+ 4731us) write_op.cc:312] APPLY: finished
0807 15:10:43.936571 (+ 63535us) log.cc:842] Serialized 77 byte log entry
0807 15:10:44.663454 (+726883us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:44.694894 (+ 31440us) write_op.cc:454] Released schema lock
0807 15:10:44.702317 (+ 7423us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:44.729703 (+ 27386us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:44.731933 (+ 2230us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11829,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":801169,"apply.run_cpu_time_us":19959,"apply.run_wall_time_us":1316539,"num_ops":10,"prepare.queue_time_us":787653,"prepare.run_cpu_time_us":13320,"prepare.run_wall_time_us":180095,"raft.queue_time_us":125134,"raft.run_cpu_time_us":8653,"raft.run_wall_time_us":556791,"replication_time_us":625898,"thread_start_us":1327610,"threads_started":5,"wal-append.queue_time_us":801016,"wal-append.run_cpu_time_us":19167,"wal-append.run_wall_time_us":2590767}]]}
I20260807 15:10:46.657013 29531 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:46.621778 29472 tablet_service.cc:1514] Processing DeleteTablet for tablet 3518672558d94e27a30f3efea0bbeab6 with delete_type TABLET_DATA_TOMBSTONED (TS 9bbe5c211ab64989a57350f34f007ced not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33668
I20260807 15:10:46.608583 32648 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:46.654556 32554 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:46.619995 32636 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:46.631349 32634 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:46.314005 32594 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.660542 32616 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:46.660310 32329 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.656148 32650 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:10:46.668848 32655 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.367s user 0.001s sys 0.000s
I20260807 15:10:46.666603 32648 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:46.666074 32582 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:46.670163 32498 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260807 15:10:46.668586 32634 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:10:46.685864 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 53536.6us
I20260807 15:10:46.682794 32612 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.688165 32329 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:46.685962 32385 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:46.687669 32637 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:10:46.672955 32636 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:46.694424 32582 raft_consensus.cc:686] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:46.678509 32656 consensus_queue.cc:1046] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260807 15:10:46.699252 32634 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:46.723500 32632 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:46.722178 32385 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.746959 32554 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:46.744467 32656 consensus_queue.cc:1046] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260807 15:10:46.728848 32637 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:46.760627 32648 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:46.771692 32611 consensus_meta.cc:287] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.739s user 0.014s sys 0.002s
I20260807 15:10:46.761258 29482 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:10:46.778769 29637 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.538s user 0.008s sys 0.035s
W20260807 15:10:46.783197 29637 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.546s user 0.009s sys 0.035s
W20260807 15:10:46.780870 32529 consensus_meta.cc:287] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.585s user 0.006s sys 0.006s
I20260807 15:10:46.759327 32582 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:46.791173 30312 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.434s user 0.013s sys 0.032s
I20260807 15:10:46.794068 32650 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.778967 32611 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:46.796248 32667 raft_consensus.cc:3032] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:46.781219 32637 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 15:10:46.806788 29449 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.848s user 0.019s sys 0.027s
W20260807 15:10:46.807219 29449 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.848s user 0.019s sys 0.027s
W20260807 15:10:46.799966 29486 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.677s user 0.024s sys 0.046s
W20260807 15:10:46.809144 29486 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.686s user 0.024s sys 0.046s
W20260807 15:10:46.801993 30312 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.445s user 0.014s sys 0.032s
W20260807 15:10:46.805804 30274 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.855s user 0.014s sys 0.049s
W20260807 15:10:46.805743 29534 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.665s user 0.022s sys 0.040s
W20260807 15:10:46.816401 29534 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.676s user 0.022s sys 0.040s
W20260807 15:10:46.800195 32626 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.598s user 0.006s sys 0.031s
W20260807 15:10:46.818996 30274 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.012s user 0.015s sys 0.049s
W20260807 15:10:46.820856 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 2.01344e+06us
I20260807 15:10:46.813347 32656 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:46.806911 32667 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:46.813191 32288 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:46.832234 32288 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:46.813036 32637 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:46.833355 32637 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:46.835003 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.836169 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.836885 29646 raft_consensus.cc:2354] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:46.829102 30274 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:46.818995 32626 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.618s user 0.007s sys 0.032s
I20260807 15:10:46.818346 32659 consensus_queue.cc:1046] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260807 15:10:46.838863 32666 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:46.839049 32634 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.840124 32636 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:46.840265 32659 raft_consensus.cc:3032] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:46.840842 32659 raft_consensus.cc:729] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:46.831707 32529 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:46.841259 32667 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.841702 32529 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:46.841822 32659 consensus_queue.cc:260] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.842950 32667 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:46.843470 32659 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:46.835677 29644 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:46.844316 32529 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:46.813197 32312 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.849669 32611 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:46.854738 29647 raft_consensus.cc:2379] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:46.856106 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.856895 29644 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:46.858484 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.859174 29644 raft_consensus.cc:1799] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Handling vote request from an unknown peer 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:46.851435 32595 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:46.861621 29644 raft_consensus.cc:2396] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260807 15:10:46.867165 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.869669 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.870647 29647 raft_consensus.cc:2379] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:46.869037 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:10:46.877655 29449 connection.cc:232] RPC call timeout handler was delayed by -1.4209134980337694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260807 15:10:46.881655 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:46.882498 29646 raft_consensus.cc:2379] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:46.892199 29644 raft_consensus.cc:2354] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:46.865402 32385 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:46.882968 32494 consensus_meta.cc:287] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.615s user 0.013s sys 0.000s
I20260807 15:10:46.876289 32627 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:46.880951 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:46.905646 29449 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:46.900312 32310 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:46.906816 32627 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:46.918589 29645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2389) took 2110 ms. Trace:
I20260807 15:10:46.925940 32288 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:46.927135 32288 raft_consensus.cc:2781] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:46.927912 32310 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.930001 32310 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:46.930541 32310 consensus_queue.cc:1046] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:46.908015 30304 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:46.932024 32627 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:46.934986 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:46.903204 32494 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:46.927487 32288 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:46.941082 32288 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:46.922112 29645 rpcz_store.cc:276] 0807 15:10:44.808504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:44.808896 (+ 392us) service_pool.cc:227] Handling call
0807 15:10:45.006529 (+197633us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 15:10:45.196552 (+190023us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:45.196580 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 15:10:45.199169 (+ 2589us) log.cc:842] Serialized 52 byte log entry
0807 15:10:46.617850 (+1418681us) raft_consensus.cc:1631] Marking committed up to 1
0807 15:10:46.617913 (+ 63us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:46.626016 (+ 8103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:46.918284 (+292268us) raft_consensus.cc:1671] finished
0807 15:10:46.918322 (+ 38us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:46.918515 (+ 193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20340,"raft.queue_time_us":129194,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":22221,"thread_start_us":1557756,"threads_started":2,"wal-append.queue_time_us":1706224}
W20260807 15:10:47.025733 29532 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.885s user 0.010s sys 0.039s
W20260807 15:10:47.273759 29532 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.133s user 0.014s sys 0.043s
I20260807 15:10:47.255029 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:10:47.153915 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 241810us
I20260807 15:10:47.018023 32312 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:47.038486 29450 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.760s user 0.029s sys 0.046s
W20260807 15:10:47.288513 29450 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.010s user 0.034s sys 0.055s
W20260807 15:10:47.038559 29533 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.914s user 0.028s sys 0.071s
W20260807 15:10:47.288868 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 2.01082e+06us
W20260807 15:10:47.289163 29533 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.165s user 0.036s sys 0.087s
I20260807 15:10:47.289564 29450 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:10:47.053032 29378 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s user 0.002s sys 0.046s
W20260807 15:10:47.290328 29378 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.764s user 0.011s sys 0.061s
I20260807 15:10:47.097682 32494 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:47.150452 29609 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.516s user 0.002s sys 0.015s
W20260807 15:10:47.145272 29608 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.521s user 0.007s sys 0.010s
W20260807 15:10:47.161016 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 299760us
W20260807 15:10:47.257191 29469 thread.cc:636] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.613s user 0.004s sys 0.006s
W20260807 15:10:47.257725 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 281388us
W20260807 15:10:47.155112 30273 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.503s user 0.002s sys 0.022s
I20260807 15:10:47.280874 29640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35570 (request call id 585) took 1010 ms. Trace:
W20260807 15:10:47.286636 29610 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.659s user 0.014s sys 0.012s
W20260807 15:10:47.332832 29610 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.720s user 0.015s sys 0.013s
W20260807 15:10:47.287919 29488 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s user 0.012s sys 0.022s
W20260807 15:10:47.290973 29609 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.657s user 0.008s sys 0.016s
I20260807 15:10:47.353708 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:47.354164 29488 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s user 0.013s sys 0.029s
I20260807 15:10:47.354446 29563 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:47.354744 30307 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s user 0.011s sys 0.022s
W20260807 15:10:47.354568 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 1.04131e+06us
W20260807 15:10:47.355165 30307 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s user 0.011s sys 0.022s
W20260807 15:10:47.291121 29608 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.667s user 0.009s sys 0.015s
I20260807 15:10:47.297490 30274 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:47.250138 29483 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.553s user 0.000s sys 0.039s
W20260807 15:10:47.300017 29469 thread.cc:602] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.656s user 0.005s sys 0.006s
I20260807 15:10:47.346933 29450 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
W20260807 15:10:47.350139 30273 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.682s user 0.013s sys 0.043s
I20260807 15:10:47.360273 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:47.350138 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.352677 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:47.335409 29640 rpcz_store.cc:276] 0807 15:10:46.270618 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:46.270799 (+ 181us) service_pool.cc:227] Handling call
0807 15:10:47.280576 (+1009777us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54002ed6d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:47.280757 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1754367232}
W20260807 15:10:47.357339 29483 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.661s user 0.000s sys 0.039s
I20260807 15:10:47.404685 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.422003 32664 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:47.422297 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 797056us
I20260807 15:10:47.295122 32634 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:47.455133 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 157739us
I20260807 15:10:47.457193 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.458436 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.461138 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.461757 30309 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
W20260807 15:10:47.461776 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 109938us
I20260807 15:10:47.457177 30274 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:47.465986 29564 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:47.467851 29566 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:47.469270 29645 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:47.457875 30308 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:47.346694 32529 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:47.471271 29449 leader_election.cc:398] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:47.473398 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.474398 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:47.475330 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.476603 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:47.477906 30274 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:47.484541 29449 leader_election.cc:401] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:10:47.492697 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.487986 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.486264 30310 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:47.496304 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.497359 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.498070 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:47.499863 29608 connection.cc:232] RPC call timeout handler was delayed by -1.0519982749829069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260807 15:10:47.485896 30309 raft_consensus.cc:2379] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 7: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:47.491288 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.507818 29566 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:47.499158 29564 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
W20260807 15:10:47.461076 30303 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.765s user 0.009s sys 0.046s
I20260807 15:10:47.512302 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:47.516953 29608 connection.cc:232] RPC call timeout handler was delayed by -1.0252837859443389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260807 15:10:47.518553 29608 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:47.521835 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.520800 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.583524 30309 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:47.528620 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.484558 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.528518 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.529296 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.530115 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.502933 32529 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:47.443545 32663 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:47.594434 29563 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:47.460785 32312 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:47.576463 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.579850 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.459345 32335 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:47.585388 30310 raft_consensus.cc:2379] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
W20260807 15:10:47.532191 32674 log.cc:924] Time spent T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.128s user 0.001s sys 0.000s
I20260807 15:10:47.614194 32663 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:47.629528 32637 consensus_meta.cc:287] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.796s user 0.012s sys 0.004s
I20260807 15:10:47.629725 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.630088 32637 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.631052 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:47.631348 32663 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:47.632294 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2181) took 2828 ms. Trace:
I20260807 15:10:47.633049 32659 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:47.633347 32684 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:47.633867 32684 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:47.628369 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.634997 29484 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:47.595803 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:47.635987 30309 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:10:47.618814 32312 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:47.637240 32683 tablet_replica.cc:330] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:10:47.638012 32312 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:47.638578 32312 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:47.638808 32288 consensus_meta.cc:287] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.697s user 0.014s sys 0.000s
I20260807 15:10:47.639135 32312 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.639364 32288 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.596942 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:47.521216 30303 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.827s user 0.009s sys 0.046s
I20260807 15:10:47.604805 29480 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 6: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:47.599251 32385 raft_consensus.cc:2781] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:47.618965 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.612358 29564 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:47.532194 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.634379 32684 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:47.484079 32671 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:47.646293 29481 raft_consensus.cc:1226] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:47.645514 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2653) took 1966 ms. Trace:
I20260807 15:10:47.655496 29485 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:47.686201 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:47.697638 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.688938 29488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2627) took 4304 ms. Trace:
I20260807 15:10:47.698793 29480 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:47.699460 29485 raft_consensus.cc:1226] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:47.650015 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.707758 30310 raft_consensus.cc:2396] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260807 15:10:47.633409 30306 raft_consensus.cc:2354] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:10:47.640209 30312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1094) took 2335 ms. Trace:
I20260807 15:10:47.644678 29570 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:47.484365 32664 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:47.592792 32677 log.cc:924] Time spent T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.101s user 0.001s sys 0.004s
I20260807 15:10:47.644023 29569 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:47.595423 32338 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:47.655783 29533 connection.cc:232] RPC call timeout handler was delayed by -2.1363147769588977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260807 15:10:47.648285 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:47.672349 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 209619us
I20260807 15:10:47.717561 29449 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:47.718896 29449 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:47.719120 32637 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:47.719667 32665 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:47.588052 32494 consensus_queue.cc:1046] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260807 15:10:47.722292 30309 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:10:47.725082 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:47.725769 29640 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 3
I20260807 15:10:47.725842 29452 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:47.719832 29449 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:47.724447 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.727965 29479 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:47.687191 29483 rpcz_store.cc:276] 0807 15:10:45.679638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:45.680596 (+ 958us) service_pool.cc:227] Handling call
0807 15:10:45.681124 (+ 528us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:45.681566 (+ 442us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:45.681607 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:45.682261 (+ 654us) log.cc:842] Serialized 26 byte log entry
0807 15:10:47.460562 (+1778301us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:47.460635 (+ 73us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:47.460716 (+ 81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:47.645235 (+184519us) raft_consensus.cc:1671] finished
0807 15:10:47.645264 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:47.645439 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1257,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":201,"thread_start_us":1673056,"threads_started":1,"wal-append.queue_time_us":1949538}
W20260807 15:10:47.729278 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 251471us
W20260807 15:10:47.702004 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 355120us
I20260807 15:10:47.642668 32693 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:47.713184 30303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1104) took 2397 ms. Trace:
I20260807 15:10:47.668102 32507 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:47.699388 29488 rpcz_store.cc:276] 0807 15:10:43.370031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:43.388678 (+ 18647us) service_pool.cc:227] Handling call
0807 15:10:43.389082 (+ 404us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:43.425014 (+ 35932us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:43.425068 (+ 54us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:44.334540 (+909472us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b2c00060e78. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94da7a7e11 00007f94da7b7442 00007f94dbdffc11 00007f94dbdc458a 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772
0807 15:10:44.334972 (+ 432us) log.cc:842] Serialized 26 byte log entry
0807 15:10:45.558512 (+1223540us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:46.617159 (+1058647us) log.cc:842] Serialized 14 byte log entry
0807 15:10:47.662208 (+1045049us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:47.662304 (+ 96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:47.662351 (+ 47us) raft_consensus.cc:1671] finished
0807 15:10:47.672044 (+ 9693us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:47.674660 (+ 2616us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":48630,"prepare.queue_time_us":1245828,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":228469,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":35459,"spinlock_wait_cycles":8112896,"thread_start_us":3291791,"threads_started":4,"wal-append.queue_time_us":1389887,"wal-append.run_cpu_time_us":2047,"wal-append.run_wall_time_us":1002080}
I20260807 15:10:47.736871 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.737529 30309 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:47.705786 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.738389 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.658391 32627 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:47.724597 32670 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:47.708415 30312 rpcz_store.cc:276] 0807 15:10:45.305013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:45.308029 (+ 3016us) service_pool.cc:227] Handling call
0807 15:10:45.308485 (+ 456us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:45.308928 (+ 443us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:45.308966 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:45.337067 (+ 28101us) log.cc:842] Serialized 26 byte log entry
0807 15:10:46.810378 (+1473311us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:10:46.810434 (+ 56us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:46.810531 (+ 97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:47.639968 (+829437us) raft_consensus.cc:1671] finished
0807 15:10:47.639988 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:47.640123 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":39477,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":61,"thread_start_us":1453626,"threads_started":1,"wal-append.queue_time_us":2283122}
I20260807 15:10:47.741935 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:47.717772 29533 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.196:43545 timed out after 1.964s (SENT) [suppressed 7 similar messages]
I20260807 15:10:47.613451 32626 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 4
I20260807 15:10:47.706189 32650 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:47.745445 32650 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:47.741604 32627 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.745977 32650 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:47.746578 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.747987 32698 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:47.749389 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.750350 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.720717 32664 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:47.632737 29486 rpcz_store.cc:276] 0807 15:10:44.803879 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:44.804047 (+ 168us) service_pool.cc:227] Handling call
0807 15:10:44.804485 (+ 438us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:45.077672 (+273187us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:45.077708 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:45.078197 (+ 489us) log.cc:842] Serialized 26 byte log entry
0807 15:10:46.809658 (+1731461us) raft_consensus.cc:1631] Marking committed up to 2
0807 15:10:46.809732 (+ 74us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:46.809833 (+ 101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:47.632056 (+822223us) raft_consensus.cc:1671] finished
0807 15:10:47.632082 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:47.632230 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16571,"raft.queue_time_us":278397,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9711,"thread_start_us":1959464,"threads_started":2,"wal-append.queue_time_us":2501427}
I20260807 15:10:47.732518 29449 leader_election.cc:398] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:47.752127 29480 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:47.657755 32534 raft_consensus.cc:3032] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:47.730374 30274 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:47.753232 32534 raft_consensus.cc:729] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:47.722065 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:47.753611 32685 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:10:47.754089 29482 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:47.754413 32534 consensus_queue.cc:260] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:47.755934 32534 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:47.733716 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:47.669631 32385 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:47.739343 30309 raft_consensus.cc:2396] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260807 15:10:47.712101 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.743247 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.765066 29488 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:47.742156 32507 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:47.767406 30310 raft_consensus.cc:2354] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8.
I20260807 15:10:47.753298 29487 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:47.770670 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:47.772090 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.761113 29482 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
W20260807 15:10:47.721685 32500 consensus_meta.cc:287] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.485s user 0.012s sys 0.013s
I20260807 15:10:47.761945 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.761830 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.764282 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:47.767148 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.772789 29481 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:47.734583 29450 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:47.735071 32694 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:10:47.789829 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.790280 29566 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:47.786804 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:47.796218 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 61709.9us
I20260807 15:10:47.796787 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.790853 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:47.740016 32681 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:47.742156 32670 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:47.797554 30309 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:47.798604 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 280223us
I20260807 15:10:47.720381 32665 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:47.800465 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:47.802737 29488 raft_consensus.cc:1226] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:47.769734 32385 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:47.802793 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.842356 30274 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:47.840641 32694 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:47.839679 29646 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:47.849880 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:47.776081 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:47.841754 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:47.837442 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:47.855700 30274 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:47.856170 29647 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:47.857707 30309 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:47.851679 29449 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:47.853709 29638 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:47.790954 29609 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:47.857645 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:47.858878 30312 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:47.859319 29642 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:47.854357 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:47.801038 32670 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:47.860615 32685 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:47.861542 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:47.808650 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:47.862253 32697 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:47.862769 29484 raft_consensus.cc:1226] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:47.871557 32697 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:47.851254 32529 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:47.871984 32697 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:47.872200 29480 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:47.866554 29645 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:47.873106 32683 raft_consensus.cc:2229] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:47.874109 32683 raft_consensus.cc:2258] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:47.735529 30303 rpcz_store.cc:276] 0807 15:10:45.313779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:45.553726 (+239947us) service_pool.cc:227] Handling call
0807 15:10:45.555367 (+ 1641us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:45.555937 (+ 570us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 15:10:45.557511 (+ 1574us) log.cc:842] Serialized 14 byte log entry
0807 15:10:47.672911 (+2115400us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:47.680536 (+ 7625us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:10:47.687330 (+ 6794us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:47.699021 (+ 11691us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:47.710881 (+ 11860us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25473,"prepare.queue_time_us":484,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":125789,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":4576,"thread_start_us":2044926,"threads_started":2,"wal-append.queue_time_us":1400365}
I20260807 15:10:47.877050 30272 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:47.877215 29449 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:47.861557 29488 raft_consensus.cc:1226] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:47.736797 32693 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.878247 32685 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election won for term 5
W20260807 15:10:47.880029 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 162287us
W20260807 15:10:47.893954 29533 connection.cc:232] RPC call timeout handler was delayed by -1.9949770949897356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260807 15:10:47.894411 29533 connection.cc:232] RPC call timeout handler was delayed by -1.6215147769544274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260807 15:10:47.894800 29533 connection.cc:232] RPC call timeout handler was delayed by -1.5990107809775509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260807 15:10:47.895155 29533 connection.cc:232] RPC call timeout handler was delayed by -1.4013503750320524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260807 15:10:47.807199 32594 raft_consensus.cc:2781] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 15:10:47.894942 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 95111.2us
I20260807 15:10:47.877648 32670 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:47.843257 32627 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:47.897044 29533 connection.cc:232] RPC call timeout handler was delayed by -1.1492117629968561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24540000000000003s for a response
W20260807 15:10:47.896869 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 106058us
I20260807 15:10:47.888902 32288 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:47.896685 32529 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:47.890676 32700 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:47.901336 32664 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:47.902154 29608 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
W20260807 15:10:47.900202 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 57139us
I20260807 15:10:47.903250 29609 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:47.910297 29533 connection.cc:232] RPC call timeout handler was delayed by -1.0589765329496004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
W20260807 15:10:47.910698 29533 connection.cc:232] RPC call timeout handler was delayed by -1.0589765329496004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260807 15:10:47.839111 32681 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.910837 32664 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.916152 32534 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:47.916553 32534 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:47.916939 32534 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:47.917640 32672 log.cc:924] Time spent T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260807 15:10:47.917841 32664 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:47.897810 32312 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:47.909480 32529 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.919440 29637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2390) took 2937 ms. Trace:
I20260807 15:10:47.904564 32685 raft_consensus.cc:686] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:47.904320 32663 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:47.926290 32663 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:47.898651 32594 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:47.927621 29644 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:47.922034 29637 rpcz_store.cc:276] 0807 15:10:44.981623 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:44.981764 (+ 141us) service_pool.cc:227] Handling call
0807 15:10:45.046917 (+ 65153us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:45.194006 (+147089us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:45.194040 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:45.210037 (+ 15997us) log.cc:842] Serialized 26 byte log entry
0807 15:10:46.783709 (+1573672us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:46.783760 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:46.783834 (+ 74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:47.919225 (+1135391us) raft_consensus.cc:1671] finished
0807 15:10:47.919244 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:47.919384 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2162,"raft.queue_time_us":166091,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":165,"thread_start_us":1686967,"threads_started":2,"wal-append.queue_time_us":2514084}
I20260807 15:10:47.910207 32662 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:47.931160 29640 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:47.914206 32708 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:47.912052 32582 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:47.972646 32582 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:47.921329 32689 log.cc:924] Time spent T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.159s user 0.000s sys 0.001s
I20260807 15:10:47.975030 32582 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:47.927191 32312 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:47.976224 32312 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:47.976694 32312 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:47.880070 32696 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260807 15:10:47.979384 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:47.980063 29564 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:47.932401 32670 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:47.933758 30272 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:10:47.981213 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 47562.5us
I20260807 15:10:47.934717 32671 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:47.937902 32681 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:47.923542 32699 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:47.939182 32662 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:47.939791 32690 log.cc:924] Time spent T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.236s user 0.000s sys 0.002s
I20260807 15:10:47.930166 32594 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:47.934146 32685 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.941350 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:48.000941 30311 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:47.943780 32663 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:47.944027 32494 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:47.944614 32682 raft_consensus.cc:2781] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:47.911067 32700 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:47.948704 32683 ts_tablet_manager.cc:1905] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:47.952575 32534 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:47.953382 32687 log.cc:924] Time spent T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.243s user 0.001s sys 0.001s
I20260807 15:10:47.953835 32529 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:47.955921 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:47.959481 29570 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:47.996160 32671 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:47.964847 32665 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:47.927037 32693 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:47.989068 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:47.960259 32507 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:47.989642 32697 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.927081 32650 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.988408 32667 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:47.901389 32694 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:47.995836 29564 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
W20260807 15:10:47.997673 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 94542.1us
I20260807 15:10:48.006681 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.007596 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:48.007856 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 129666us
I20260807 15:10:48.013065 29485 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:47.963415 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.035360 29563 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
W20260807 15:10:48.019989 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 117919us
I20260807 15:10:48.024154 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:47.995980 32709 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:48.026813 29569 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:48.027757 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:48.028929 32662 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:48.058112 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:48.059077 29564 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:48.030555 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 120110us
I20260807 15:10:48.004204 32682 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:48.072299 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.073123 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.073948 29568 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:48.032559 32695 raft_consensus.cc:3032] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:48.074324 29638 raft_consensus.cc:1226] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:48.074555 32695 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:48.074318 32650 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:48.073192 32682 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:48.075567 32695 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.033068 30306 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:48.077168 32695 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:48.072865 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.078655 29645 raft_consensus.cc:2379] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 3: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:47.992513 32684 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.081869 32698 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:48.037185 29609 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:48.084581 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 47476.1us
I20260807 15:10:48.075413 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.038854 32700 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:48.040414 32667 raft_consensus.cc:686] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:48.088919 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:48.041745 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.044103 29644 raft_consensus.cc:1226] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:48.045065 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:48.049379 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.100020 29643 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:48.101454 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.049794 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.050028 29449 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:48.050515 29640 raft_consensus.cc:1226] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:48.072299 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.072576 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.006950 32699 raft_consensus.cc:686] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:48.099395 29565 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:48.109078 29643 raft_consensus.cc:2379] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 3: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:48.086700 29452 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.087260 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:48.092712 29638 raft_consensus.cc:1226] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:48.084901 32684 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:48.110119 29487 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:48.114281 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:48.119000 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:47.997133 32708 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:48.120952 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:48.121325 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.121769 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:48.122335 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:48.052692 32626 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:48.127245 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.204236 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:48.204967 29645 raft_consensus.cc:2396] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 15:10:48.127403 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:48.208630 29641 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 2: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:48.128615 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:48.132159 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 82227.5us
I20260807 15:10:48.011406 32385 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.121665 30305 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:48.107220 32650 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:48.225963 32650 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:48.226444 32650 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:48.226897 32594 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.131057 32667 consensus_queue.cc:237] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.109526 32335 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:48.185461 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:48.193218 32711 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260807 15:10:48.213655 32713 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.207s user 0.005s sys 0.000s
I20260807 15:10:48.198938 30274 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.206799 29452 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:48.257526 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 58678.8us
I20260807 15:10:48.257403 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.258843 30274 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.261415 29482 raft_consensus.cc:1226] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:48.207547 29485 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:48.212623 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:48.213855 29569 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:48.221450 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.268447 29638 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:48.197917 32708 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:48.222353 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.223237 32385 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:48.223743 29479 raft_consensus.cc:1226] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:48.052048 32709 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:48.283147 32709 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:48.230670 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.285100 29566 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:48.231508 32699 consensus_queue.cc:237] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:48.232558 32697 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:48.233587 32534 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:48.234328 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.237015 29531 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:48.237659 32662 consensus_queue.cc:1046] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 15:10:48.219633 32338 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:48.239395 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:48.239512 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.240706 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:48.215425 32684 consensus_queue.cc:1046] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260807 15:10:48.252390 29564 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:48.247200 29608 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:48.310743 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 63669.8us
I20260807 15:10:48.311425 29608 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.313727 29608 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:48.268877 29645 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:48.278852 29638 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:48.279539 29483 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:48.289618 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.255299 32711 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:48.230805 32682 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:48.263300 32634 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:48.305634 29563 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:48.322971 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.198359 30311 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:48.305745 29565 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:48.274505 32507 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:48.257081 32335 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.316094 29449 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:48.260094 32656 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:48.316951 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 80016.6us
I20260807 15:10:48.308367 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:48.330950 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 419710us
I20260807 15:10:48.332535 29646 raft_consensus.cc:2379] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 4: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:48.259862 32312 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.337525 29563 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:48.335819 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.341037 29638 raft_consensus.cc:2379] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:48.341961 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.306942 32694 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:48.347091 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.343884 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.347849 29645 raft_consensus.cc:2379] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 4: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:48.344583 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.346150 29637 raft_consensus.cc:1226] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:48.322459 32679 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:48.350893 29638 raft_consensus.cc:2379] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 4: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:48.323240 32529 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:48.352093 29533 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.343842 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.336400 32310 raft_consensus.cc:3032] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:48.354547 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.355433 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.326272 32708 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:48.319695 32711 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:10:48.373260 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 59627.7us
I20260807 15:10:48.373957 29608 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.374703 32727 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:48.363826 29647 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:48.349845 32626 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:48.331394 32700 raft_consensus.cc:2741] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 15:10:48.366642 29640 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:48.319108 32338 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:48.365334 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:48.367441 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:48.362072 32663 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:48.363401 32679 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:48.381543 29638 raft_consensus.cc:1226] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:48.369764 29533 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:48.363819 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 81191.1us
I20260807 15:10:48.388064 32626 raft_consensus.cc:686] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:48.388134 32500 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:48.389269 32626 consensus_queue.cc:237] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:48.344061 32666 consensus_queue.cc:1046] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260807 15:10:48.391036 32666 raft_consensus.cc:3032] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:48.391382 32682 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:48.360980 32634 consensus_queue.cc:1046] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260807 15:10:48.366011 32529 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:48.392645 32529 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:48.392956 32634 raft_consensus.cc:3032] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:48.393404 32634 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:48.394239 32634 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.395489 32634 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:48.367965 32722 log.cc:924] Time spent T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
I20260807 15:10:48.307799 32697 consensus_queue.cc:1046] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260807 15:10:48.396665 32697 raft_consensus.cc:3032] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:48.397047 32697 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:48.397485 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.397761 32594 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:48.377146 32721 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:48.397869 32697 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.371939 32708 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:48.399061 32708 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:48.399315 32697 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:48.401207 32686 log.cc:924] Time spent T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.690s user 0.000s sys 0.011s
I20260807 15:10:48.392961 32671 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:48.381253 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:48.403175 29646 raft_consensus.cc:595] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:48.404147 30308 raft_consensus.cc:1226] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:48.404749 29646 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:10:48.346151 32662 consensus_queue.cc:1046] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260807 15:10:48.406601 32662 raft_consensus.cc:3032] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:48.406832 29646 raft_consensus.cc:1226] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:48.406977 32662 raft_consensus.cc:729] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:48.407877 32662 consensus_queue.cc:260] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.409153 32335 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:48.409301 32662 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:48.409667 32712 consensus_queue.cc:1046] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:10:48.411394 32312 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:48.403687 32671 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:48.372066 32310 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:48.412730 32310 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:48.414057 32310 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:48.389972 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.402693 30307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1119) took 1743 ms. Trace:
I20260807 15:10:48.409929 32679 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:48.398150 29644 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:48.384523 32338 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:48.376250 29608 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:48.420387 30307 rpcz_store.cc:276] 0807 15:10:46.659554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:46.661349 (+ 1795us) service_pool.cc:227] Handling call
0807 15:10:46.671441 (+ 10092us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:46.671641 (+ 200us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:46.671665 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:46.676904 (+ 5239us) log.cc:842] Serialized 26 byte log entry
0807 15:10:47.355639 (+678735us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:47.355682 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:47.355753 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:48.400636 (+1044883us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:10:48.402398 (+ 1762us) raft_consensus.cc:1671] finished
0807 15:10:48.402419 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:48.402624 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":38891392,"thread_start_us":659383,"threads_started":1,"wal-append.queue_time_us":973183}
I20260807 15:10:48.436725 32312 raft_consensus.cc:2781] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:48.437489 32312 raft_consensus.cc:686] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:48.438690 32312 consensus_queue.cc:237] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.427767 29646 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260807 15:10:48.441697 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 65531.2us
I20260807 15:10:48.449469 29608 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:48.452455 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 245724us
I20260807 15:10:48.391438 32666 raft_consensus.cc:729] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:48.455787 29449 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:48.600016 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:10:48.600152 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 210509us
I20260807 15:10:48.477074 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:48.603312 29646 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
I20260807 15:10:48.603502 29533 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:48.605892 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 156542us
W20260807 15:10:48.512408 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 309363us
I20260807 15:10:48.607295 29608 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:48.608089 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 152411us
I20260807 15:10:48.608613 29645 raft_consensus.cc:1226] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
W20260807 15:10:48.607677 29609 leader_election.cc:334] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545): Timed out: RequestConsensusVote RPC to 127.27.144.196:43545 timed out after 1.705s (SENT)
I20260807 15:10:48.610611 30274 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.611707 29608 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.612177 29641 raft_consensus.cc:1261] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 15:10:48.613317 30272 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:48.615008 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.615667 29609 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.617791 30274 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.620366 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:48.622537 29608 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.623415 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:48.626514 32288 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:10:48.622601 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:48.453168 32500 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:48.632928 29452 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.633322 29609 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.636813 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:48.610060 32721 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:48.613955 32705 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:48.613021 32699 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:48.613533 32684 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:10:48.621884 32703 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:48.668514 29647 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:10:48.630702 32682 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:48.637677 32663 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:48.745922 32663 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:48.675542 32681 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:48.746407 32663 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:48.746867 32681 raft_consensus.cc:686] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:48.747759 32681 consensus_queue.cc:237] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:48.571259 32711 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.752815 32711 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:48.753530 29480 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:48.673009 32699 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:48.755370 32699 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:48.666982 32705 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 15:10:48.731818 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 55346.8us
I20260807 15:10:48.655695 32627 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:10:48.733160 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 115472us
I20260807 15:10:48.734997 29647 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:48.767210 30274 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.740119 32684 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:48.742012 32312 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:48.737437 32682 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:48.745296 32683 ts_tablet_manager.cc:1918] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
W20260807 15:10:48.811053 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 197786us
I20260807 15:10:48.757836 32637 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:48.630422 32716 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:48.761020 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 144707us
I20260807 15:10:48.770202 32697 consensus_queue.cc:1046] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:48.770876 32335 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:48.776754 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:48.677103 32703 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:10:48.809958 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 187471us
I20260807 15:10:48.918356 29608 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.821062 32637 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 15:10:48.812173 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 139074us
I20260807 15:10:48.645346 32671 consensus_queue.cc:1035] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260807 15:10:48.817193 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:48.663342 32729 consensus_queue.cc:1046] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
I20260807 15:10:48.766769 32705 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:48.865034 29533 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:48.867352 29646 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:48.811414 32682 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:48.808452 29647 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.912438 30311 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:48.746318 32679 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.812242 30310 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260807 15:10:48.869540 32683 log.cc:1196] T 748d0394657643cfbf71e2bac60ff2f2 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/748d0394657643cfbf71e2bac60ff2f2
I20260807 15:10:48.926564 29609 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.934396 29608 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:48.961964 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 97023.7us
I20260807 15:10:48.968490 29647 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:10:48.922155 32703 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:48.975467 29533 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:10:48.977995 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 194137us
I20260807 15:10:48.979316 29533 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:48.930966 32637 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:48.737689 32666 consensus_queue.cc:260] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:48.981918 29533 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:48.987275 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 57437.3us
I20260807 15:10:48.989988 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:48.991724 29533 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:48.988677 32662 raft_consensus.cc:2741] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 15:10:48.992851 32662 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:48.993525 32685 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 15:10:48.994020 32721 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:48.994439 32721 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:48.994791 32721 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:48.995397 32750 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:10:48.996930 32732 log.cc:924] Time spent T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.262s user 0.003s sys 0.000s
W20260807 15:10:48.997567 32739 log.cc:924] Time spent T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.076s user 0.000s sys 0.001s
W20260807 15:10:48.999572 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 65500us
I20260807 15:10:48.999918 32681 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 15:10:49.000223 32634 consensus_meta.cc:287] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.604s user 0.008s sys 0.002s
I20260807 15:10:49.000367 29608 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:48.989010 32534 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260807 15:10:49.002032 32717 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:49.002447 32717 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:49.002775 32717 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:49.004383 32692 raft_consensus.cc:3032] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:49.004763 32692 raft_consensus.cc:729] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:49.005352 32699 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:49.006006 32709 consensus_meta.cc:287] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.722s user 0.012s sys 0.000s
I20260807 15:10:49.005534 32692 consensus_queue.cc:260] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.006695 32692 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:49.006424 32709 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.007349 32699 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:49.007416 29488 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
W20260807 15:10:49.008438 32730 log.cc:924] Time spent T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.206s user 0.000s sys 0.000s
I20260807 15:10:48.962162 32312 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:49.009796 32312 raft_consensus.cc:686] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:49.009933 32683 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33668 (request call id 770) took 2476 ms. Trace:
I20260807 15:10:49.011044 29646 raft_consensus.cc:1226] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:49.010704 32312 consensus_queue.cc:237] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:48.997579 29637 raft_consensus.cc:1226] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:49.016618 30311 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:49.019016 29609 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:49.019662 29564 raft_consensus.cc:1226] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
W20260807 15:10:48.971355 32708 consensus_meta.cc:287] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.572s user 0.010s sys 0.004s
I20260807 15:10:49.002064 29608 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:49.023934 29647 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 10. (term mismatch)
I20260807 15:10:49.024485 29647 pending_rounds.cc:76] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Aborting all ops after (but not including) 9
I20260807 15:10:49.026914 29564 raft_consensus.cc:1226] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:49.029417 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.029865 29569 raft_consensus.cc:1226] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:49.022475 32665 raft_consensus.cc:3032] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:49.031045 32665 raft_consensus.cc:729] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:49.035168 29609 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:49.035796 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:49.024778 29647 pending_rounds.cc:97] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Aborting uncommitted NO_OP operation due to leader change: 7.10
I20260807 15:10:48.976684 32664 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:49.000425 32681 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:49.013806 32500 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:49.038269 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.043327 29638 raft_consensus.cc:1261] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:49.043941 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.050099 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.069582 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.070951 29640 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:49.072449 29647 raft_consensus.cc:2866] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:10:49.072747 29563 raft_consensus.cc:1226] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:49.051023 29609 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:49.061955 29642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59992 (request call id 2374) took 1013 ms. Trace:
I20260807 15:10:49.034307 32699 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 15:10:49.079056 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 110728us
W20260807 15:10:49.062711 32310 consensus_meta.cc:287] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.648s user 0.010s sys 0.003s
I20260807 15:10:49.065918 29565 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.031848 32709 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:49.052729 32737 log.cc:924] Time spent T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.149s user 0.001s sys 0.001s
W20260807 15:10:49.045801 32650 consensus_meta.cc:287] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.819s user 0.010s sys 0.002s
I20260807 15:10:49.091696 29486 raft_consensus.cc:1226] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:49.039145 29608 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:49.098608 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 59580.8us
I20260807 15:10:49.075630 29449 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:49.074874 29642 rpcz_store.cc:276] 0807 15:10:48.048597 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:48.049484 (+ 887us) service_pool.cc:227] Handling call
0807 15:10:49.061752 (+1012268us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540031f954. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:49.061895 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":810886912}
I20260807 15:10:49.100114 29608 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:49.036350 32708 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.062443 32664 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:49.075984 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.062984 32751 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 15:10:49.058416 32529 consensus_meta.cc:287] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.665s user 0.005s sys 0.005s
I20260807 15:10:49.050303 32727 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:49.110913 29488 raft_consensus.cc:1226] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:49.080395 32666 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:49.057139 32679 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:49.077731 32698 consensus_queue.cc:1035] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260807 15:10:49.056241 32753 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:49.184095 32716 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:49.058733 32500 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:49.192996 32716 raft_consensus.cc:686] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:49.193044 32500 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:49.164459 32729 consensus_queue.cc:1046] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260807 15:10:49.194074 32716 consensus_queue.cc:237] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.109380 32714 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:49.164216 32711 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:49.109450 32663 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.195600 32714 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.010309 32683 rpcz_store.cc:276] 0807 15:10:46.533937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:46.633233 (+ 99296us) service_pool.cc:227] Handling call
0807 15:10:47.441438 (+808205us) ts_tablet_manager.cc:1145] Deleting tablet 748d0394657643cfbf71e2bac60ff2f2
0807 15:10:47.531490 (+ 90052us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b180006b680. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94dba5382c 00007f94d8e7e9dc 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e9be22 00007f94e0d54734 00007f94e0d023ee 00007f94da3061c4
0807 15:10:47.636802 (+105312us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800001898. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64e82 00007f94e1d7d8b9 00007f94e0c905d8 00007f94e0d54389 00007f94e0d54983 00007f94e0d84e10 00007f94e0d6be0d 00007f94e0d6bdb9 00007f94e0d6bd49
0807 15:10:47.636915 (+ 113us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 15:10:48.384353 (+747438us) tablet_metadata.cc:641] Metadata flushed
0807 15:10:48.745029 (+360676us) tablet_metadata.cc:641] Metadata flushed
0807 15:10:49.009844 (+264815us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":155169,"spinlock_wait_cycles":130893952,"tablet-delete.queue_time_us":706097,"thread_start_us":715560,"threads_started":1}
I20260807 15:10:49.103454 32656 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:49.061993 32665 consensus_queue.cc:260] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.201488 32656 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.051730 32681 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:49.202690 32665 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:49.205129 32748 raft_consensus.cc:3032] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:49.205561 32748 raft_consensus.cc:729] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:49.206385 32748 consensus_queue.cc:260] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.163347 32709 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260807 15:10:49.206604 32685 consensus_queue.cc:1046] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:49.208901 32685 raft_consensus.cc:3032] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:49.209265 32685 raft_consensus.cc:729] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:49.210733 32714 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:49.210387 32685 consensus_queue.cc:260] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.207698 32748 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:49.146807 32740 log.cc:924] Time spent T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.219s user 0.000s sys 0.001s
I20260807 15:10:49.213675 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.260895 29563 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:49.262068 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.046695 32626 consensus_queue.cc:1046] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260807 15:10:49.201640 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet 748d0394657643cfbf71e2bac60ff2f2 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:49.121075 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.183246 32750 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:49.110486 32664 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:10:49.243820 32667 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s user 0.004s sys 0.004s
I20260807 15:10:49.247191 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:49.201510 32683 tablet_replica.cc:330] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: stopping tablet replica
I20260807 15:10:49.137871 32727 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:49.253014 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.311805 29567 raft_consensus.cc:2379] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:49.253888 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.161784 32708 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:49.255148 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.258430 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.259285 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.246373 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 373) took 6754 ms. Trace:
W20260807 15:10:49.263685 29367 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 62212.6us
I20260807 15:10:49.145946 32684 raft_consensus.cc:3032] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:49.264283 29568 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:49.257735 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.321961 29569 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:49.236719 30307 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:49.137475 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.217159 32711 raft_consensus.cc:686] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:49.306475 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.200317 32663 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:49.117865 32529 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:49.269538 32667 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s user 0.004s sys 0.004s
I20260807 15:10:49.266255 32750 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:49.322988 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.110920 32650 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.179085 32717 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.299366 32696 raft_consensus.cc:3032] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:10:49.332374 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:49.339828 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 288874us
I20260807 15:10:49.322049 32685 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:49.337617 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.342758 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.346625 29609 leader_election.cc:398] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8.
I20260807 15:10:49.321368 32684 raft_consensus.cc:729] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:49.376441 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:49.318248 29378 rpcz_store.cc:276] 0807 15:10:42.492505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.493923 (+ 1418us) service_pool.cc:227] Handling call
0807 15:10:43.371621 (+877698us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e1d1ed6c 00007f94e1e18c3e 00007f94e012afb4 00007f94e012af42 00007f94e012ae71 00007f94e012adec 00007f94e012a0a2 00007f94da1ee94c 00007f94da1edd86
0807 15:10:49.246282 (+5874661us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:47.604442 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:47.837926 (+233484us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:47.842482 (+ 4556us) write_op.cc:435] Acquired schema lock
0807 15:10:47.842503 (+ 21us) tablet.cc:660] Decoding operations
0807 15:10:47.921258 (+ 78755us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:47.921333 (+ 75us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:47.925564 (+ 4231us) tablet.cc:683] Acquiring locks for 5 operations
0807 15:10:47.937373 (+ 11809us) tablet.cc:699] Row locks acquired
0807 15:10:47.937395 (+ 22us) write_op.cc:260] PREPARE: finished
0807 15:10:47.937541 (+ 146us) write_op.cc:270] Start()
0807 15:10:47.937648 (+ 107us) write_op.cc:276] Timestamp: P: 1786115447937496 usec, L: 0
0807 15:10:47.937673 (+ 25us) op_driver.cc:331] REPLICATION: starting
0807 15:10:47.938398 (+ 725us) log.cc:842] Serialized 2099 byte log entry
0807 15:10:48.447964 (+509566us) op_driver.cc:444] REPLICATION: finished
0807 15:10:48.733794 (+285830us) write_op.cc:301] APPLY: starting
0807 15:10:48.737449 (+ 3655us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:48.780130 (+ 42681us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:48.905227 (+125097us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:49.047313 (+142086us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:49.047560 (+ 247us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0807 15:10:49.047607 (+ 47us) write_op.cc:312] APPLY: finished
0807 15:10:49.047869 (+ 262us) log.cc:842] Serialized 47 byte log entry
0807 15:10:49.048072 (+ 203us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:49.048183 (+ 111us) write_op.cc:454] Released schema lock
0807 15:10:49.048234 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:49.048540 (+ 306us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:49.048574 (+ 34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":655119,"reported_tablets":17,"spinlock_wait_cycles":1013014400,"child_traces":[["op",{"apply.queue_time_us":211618,"apply.run_cpu_time_us":5005,"apply.run_wall_time_us":372982,"num_ops":5,"prepare.queue_time_us":1044589,"prepare.run_cpu_time_us":17201,"prepare.run_wall_time_us":422047,"raft.queue_time_us":53139,"raft.run_cpu_time_us":4147,"raft.run_wall_time_us":123539,"replication_time_us":493722,"thread_start_us":914469,"threads_started":4,"wal-append.queue_time_us":60255}]]}
I20260807 15:10:49.379194 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:49.381515 32758 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:49.383700 29643 raft_consensus.cc:1226] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:49.384600 32716 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:49.385139 32716 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:49.385478 32529 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:49.386003 32716 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.389729 29565 raft_consensus.cc:3032] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:49.390183 29565 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:49.390955 29565 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.391314 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.391144 32637 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.389729 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.392969 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.393489 32637 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:49.376044 32682 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.394809 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:49.395423 29647 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:49.393684 29569 raft_consensus.cc:2379] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:49.337513 32750 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:49.342651 32696 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:49.390988 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:49.397567 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:49.401015 29565 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:49.396224 32682 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:49.413368 29609 leader_election.cc:398] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:10:49.410742 29566 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:49.342300 32656 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:49.450075 29647 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 7.
I20260807 15:10:49.376498 32662 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:49.456350 30272 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:49.459939 29561 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
W20260807 15:10:49.473379 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 373295us
I20260807 15:10:49.474494 29608 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:49.477032 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 86136.5us
I20260807 15:10:49.458500 29380 catalog_manager.cc:5495] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:49.484342 29609 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:49.483794 29608 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:49.485999 29380 catalog_manager.cc:5495] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:49.403774 32721 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.493857 29568 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:49.408782 32696 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.398975 32758 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.509086 29488 raft_consensus.cc:1226] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:49.509234 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:49.509922 29486 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:49.469177 32656 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:10:49.468312 32703 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.517272 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:49.472361 32662 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:49.527468 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:49.506830 29380 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 4 to 5, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 5 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:49.542158 29480 raft_consensus.cc:1226] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:10:49.540994 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:49.491823 32529 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:49.542124 29609 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:49.534121 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.543923 29380 catalog_manager.cc:5495] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 2 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:49.509990 29565 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:10:49.513985 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:49.514976 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:49.547219 29479 raft_consensus.cc:2379] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:49.548141 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:49.512311 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:49.515872 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:49.551837 29482 raft_consensus.cc:2379] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:49.514192 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:49.429159 32705 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.554953 29646 raft_consensus.cc:1226] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:49.503118 32746 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:10:49.560312 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:49.540997 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:49.561586 30305 raft_consensus.cc:2379] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:49.562320 32705 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:49.542403 32662 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.553812 29486 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:49.566145 29483 raft_consensus.cc:2354] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4.
I20260807 15:10:49.501559 32765 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:49.505291 32682 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:49.572108 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.573457 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.528239 32755 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:49.485397 32664 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.575593 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:49.574851 30273 leader_election.cc:334] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.630s (SENT)
I20260807 15:10:49.598402 30273 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:49.574333 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.581881 29565 raft_consensus.cc:2354] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:10:49.582911 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:49.588675 32656 raft_consensus.cc:686] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 7 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:49.503192 300 consensus_queue.cc:1046] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260807 15:10:49.479643 32684 consensus_queue.cc:260] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.471278 32711 consensus_queue.cc:237] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:49.621349 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 243142us
I20260807 15:10:49.622689 29564 raft_consensus.cc:2379] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:10:49.591418 302 log.cc:924] Time spent T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
W20260807 15:10:49.593096 32759 log.cc:924] Time spent T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.134s user 0.000s sys 0.001s
I20260807 15:10:49.596252 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:49.581022 29566 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:10:49.628127 30273 leader_election.cc:334] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.654s (SENT)
I20260807 15:10:49.600018 29642 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:49.611158 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.629724 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:49.612481 29608 leader_election.cc:398] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:10:49.613034 29570 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:49.630791 29608 leader_election.cc:401] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 15:10:49.630883 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:49.605074 29531 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:49.616748 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:49.632326 29645 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:49.580340 32765 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:49.625154 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:49.637522 29560 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 15:10:49.607071 32767 log.cc:924] Time spent T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.118s user 0.000s sys 0.001s
I20260807 15:10:49.632951 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:49.587653 32746 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:49.615404 32682 raft_consensus.cc:686] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:49.636610 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:49.613962 32634 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 15:10:49.647224 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 119588us
I20260807 15:10:49.650003 29533 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:49.620451 32650 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:49.627230 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 82000.5us
I20260807 15:10:49.656694 29569 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:49.665730 29641 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:10:49.631785 32705 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:49.666698 29641 raft_consensus.cc:595] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:49.638993 32594 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:49.641041 32765 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:49.674844 32721 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:49.674664 32682 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.675863 32703 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:49.675949 312 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:49.676848 32665 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:10:49.677012 304 log.cc:924] Time spent T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260807 15:10:49.677985 32758 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:49.680087 32662 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:49.630959 306 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:49.652928 32312 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:49.710865 30304 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:49.712186 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:49.688508 29609 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:49.606926 32755 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:49.714171 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 78975.5us
I20260807 15:10:49.694257 29566 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
W20260807 15:10:49.704782 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 50481.8us
W20260807 15:10:49.707741 32764 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
W20260807 15:10:49.720122 30273 leader_election.cc:334] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.771s (SENT)
I20260807 15:10:49.654888 32681 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.738119 29608 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:49.741920 29609 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:49.744182 29609 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:49.684540 32705 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.745323 29531 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:49.685935 32594 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.750608 29640 raft_consensus.cc:1226] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:49.711673 306 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:49.751204 29531 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:49.739454 311 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:49.687640 32656 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:49.698946 32750 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:49.785017 30273 leader_election.cc:334] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.826s (SENT)
I20260807 15:10:49.767477 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:49.795111 29609 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:49.795387 30273 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:49.766067 29645 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
W20260807 15:10:49.798177 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 48633.1us
I20260807 15:10:49.820575 29608 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:49.824607 29486 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:49.825224 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:10:49.828639 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 43694.8us
I20260807 15:10:49.752537 32763 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:49.761719 32721 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:49.739166 32662 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260807 15:10:49.839138 29642 raft_consensus.cc:2379] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:49.739143 32665 consensus_queue.cc:1046] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260807 15:10:49.756008 312 consensus_queue.cc:1046] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:49.765625 32746 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:49.793946 32699 raft_consensus.cc:979] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:49.748548 32703 consensus_queue.cc:1046] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.087s
I20260807 15:10:49.761329 306 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:49.862288 29486 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:49.838336 32757 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:10:49.878026 30273 leader_election.cc:334] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.937s (SENT)
I20260807 15:10:49.824679 32664 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:49.883363 30273 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:49.840094 32650 raft_consensus.cc:2781] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:49.852857 32748 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:49.852897 32721 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:49.824283 32708 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260807 15:10:49.908427 29449 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:49.893079 32699 raft_consensus.cc:2741] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260807 15:10:49.880645 317 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:49.890254 32758 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:49.893667 32664 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:49.899544 32721 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:49.900511 32650 raft_consensus.cc:686] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:49.921142 32753 raft_consensus.cc:1067] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:10:49.953205 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:49.958616 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 138151us
I20260807 15:10:49.959632 29608 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:49.899693 32748 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:49.970778 316 log.cc:924] Time spent T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.071s user 0.001s sys 0.000s
I20260807 15:10:49.971988 32765 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.973366 32717 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:49.973507 308 log.cc:924] Time spent T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.232s user 0.000s sys 0.000s
I20260807 15:10:50.035429 32765 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:49.980080 32746 raft_consensus.cc:686] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:10:50.104382 315 log.cc:924] Time spent T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.179s user 0.000s sys 0.001s
I20260807 15:10:50.104481 32748 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:50.059854 32750 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:50.034759 32758 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.114283 328 raft_consensus.cc:3032] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:50.114863 328 raft_consensus.cc:729] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
W20260807 15:10:50.116912 324 log.cc:924] Time spent T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.057s user 0.001s sys 0.000s
I20260807 15:10:50.115828 32758 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.124601 300 raft_consensus.cc:3032] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:50.125341 300 raft_consensus.cc:729] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:50.124975 328 consensus_queue.cc:260] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.126432 300 consensus_queue.cc:260] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.126953 328 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:50.127691 300 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:50.127724 306 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.061836 32594 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.244787 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:50.246511 29483 raft_consensus.cc:2396] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260807 15:10:50.170512 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 210824us
I20260807 15:10:49.992283 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:49.981218 32500 consensus_meta.cc:287] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.787s user 0.014s sys 0.000s
I20260807 15:10:50.250263 32500 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.252113 29563 raft_consensus.cc:1226] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:50.252466 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.253427 32500 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:50.174680 30273 leader_election.cc:334] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.069s (SENT)
I20260807 15:10:50.254460 30273 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:50.177091 32746 consensus_queue.cc:237] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.256945 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:50.180938 305 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:10:50.181160 32288 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.261631 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:50.261978 32288 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.262701 29569 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:49.954991 32338 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:50.182592 32711 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.129303 311 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:50.203599 337 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:50.213541 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 418361us
I20260807 15:10:50.265491 337 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:49.993853 32705 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.034475 32755 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:50.225349 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:50.235952 306 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.064934 32650 consensus_queue.cc:237] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.242776 32758 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:50.258414 29561 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:50.260818 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:50.264423 305 raft_consensus.cc:686] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:49.964176 32681 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:50.272101 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.274986 32338 raft_consensus.cc:686] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:50.264614 32711 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:50.281075 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 106697us
I20260807 15:10:50.284678 30274 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:50.288456 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:50.288919 30306 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:50.289430 32288 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:50.283587 32749 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:50.301358 32662 raft_consensus.cc:3032] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:50.301939 32705 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.304355 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:10:50.308194 29533 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.572s user 0.000s sys 0.039s
I20260807 15:10:50.308722 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:50.321152 29479 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:50.321722 32338 consensus_queue.cc:237] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.324061 32697 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:50.325006 32697 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.325436 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:50.326532 30306 raft_consensus.cc:2379] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 4: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:50.317332 32662 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:50.329320 32662 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.327061 32705 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.322326 29570 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:10:50.332561 29533 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.679s user 0.000s sys 0.040s
W20260807 15:10:50.335843 30273 leader_election.cc:334] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.244s (SENT)
I20260807 15:10:50.336491 30273 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:50.340878 29486 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:50.323568 305 consensus_queue.cc:237] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.342581 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:50.344921 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:50.346007 29482 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 6
I20260807 15:10:50.349875 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:50.350612 29643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59992 (request call id 2386) took 2148 ms. Trace:
W20260807 15:10:50.356117 30307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48588 (request call id 800) took 1754 ms (client timeout 1609 ms). Trace:
W20260807 15:10:50.356618 30307 rpcz_store.cc:269] 0807 15:10:48.601850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:48.602298 (+ 448us) service_pool.cc:227] Handling call
0807 15:10:50.355687 (+1753389us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400430654. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:50.355867 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":901207808}
I20260807 15:10:50.357151 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.360149 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:50.362915 29483 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260807 15:10:50.363364 29483 pending_rounds.cc:76] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Aborting all ops after (but not including) 5
I20260807 15:10:50.351640 29560 raft_consensus.cc:2379] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:50.343686 29568 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:50.363657 29483 pending_rounds.cc:97] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260807 15:10:50.373067 29483 raft_consensus.cc:2866] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:10:50.333783 32697 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:50.376109 29569 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:50.351193 29643 rpcz_store.cc:276] 0807 15:10:48.202409 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:48.202563 (+ 154us) service_pool.cc:227] Handling call
0807 15:10:48.202896 (+ 333us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:49.384180 (+1181284us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:50.349931 (+965751us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002ee5d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:50.350340 (+ 409us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2715182464}
W20260807 15:10:50.384537 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 48773.7us
I20260807 15:10:50.385308 32634 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:50.386119 32634 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:50.388629 30306 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:50.390867 32500 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:50.391377 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 50142.6us
I20260807 15:10:50.391670 32500 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.394197 32500 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.363554 32711 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:50.395987 32685 consensus_meta.cc:287] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 1.048s user 0.015s sys 0.002s
I20260807 15:10:50.333035 337 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:50.397482 30312 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:50.402558 29646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2445) took 1020 ms. Trace:
I20260807 15:10:50.403031 29646 rpcz_store.cc:276] 0807 15:10:49.381913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:49.382210 (+ 297us) service_pool.cc:227] Handling call
0807 15:10:49.450673 (+ 68463us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:49.555415 (+104742us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:50.402062 (+846647us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000eecd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:50.402358 (+ 296us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":239334272}
I20260807 15:10:50.404700 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 829) took 1016 ms. Trace:
I20260807 15:10:50.405112 29567 rpcz_store.cc:276] 0807 15:10:49.388569 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:49.392339 (+ 3770us) service_pool.cc:227] Handling call
0807 15:10:49.762055 (+369716us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:49.762338 (+ 283us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:49.762371 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:49.762413 (+ 42us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:49.762466 (+ 53us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:49.762544 (+ 78us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:50.404271 (+641727us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54003197d0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:50.404470 (+ 199us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":102886,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":20361,"spinlock_wait_cycles":849531776}
I20260807 15:10:50.411713 32705 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.398429 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 812) took 1289 ms. Trace:
I20260807 15:10:50.408989 29486 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:50.416754 29564 rpcz_store.cc:276] 0807 15:10:49.109080 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:49.115522 (+ 6442us) service_pool.cc:227] Handling call
0807 15:10:50.397974 (+1282452us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540006e354. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:50.398226 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":687917312}
I20260807 15:10:50.421509 32662 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:50.445674 29567 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:10:50.446825 29567 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:50.447319 29567 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:10:50.456274 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 171893us
W20260807 15:10:50.460271 32666 consensus_meta.cc:287] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 1.216s user 0.007s sys 0.015s
I20260807 15:10:50.460476 29570 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:50.461452 32685 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.461849 32684 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:50.462025 32685 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.465400 32685 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:50.467777 347 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.156s user 0.000s sys 0.002s
I20260807 15:10:50.467942 29640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2441) took 1286 ms. Trace:
I20260807 15:10:50.468541 29640 rpcz_store.cc:276] 0807 15:10:49.181591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:49.183157 (+ 1566us) service_pool.cc:227] Handling call
0807 15:10:49.183469 (+ 312us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:49.762376 (+578907us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:50.467314 (+704938us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54003c8a54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:50.467630 (+ 316us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1303873920}
W20260807 15:10:50.471689 32312 consensus_meta.cc:287] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.763s user 0.015s sys 0.005s
I20260807 15:10:50.472172 32312 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3.
I20260807 15:10:50.472254 29482 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:50.472862 29637 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
W20260807 15:10:50.475238 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 825266us
I20260807 15:10:50.475404 32696 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:50.476516 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:50.478250 29533 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:50.479192 32500 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:50.479600 32500 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:50.480022 32500 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:50.483044 32745 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:50.490775 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:50.490778 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.493173 29637 raft_consensus.cc:2379] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 4: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:50.493829 30310 raft_consensus.cc:1226] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
W20260807 15:10:50.495252 32763 consensus_meta.cc:287] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.638s user 0.013s sys 0.008s
I20260807 15:10:50.495760 32763 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:50.496536 29642 raft_consensus.cc:1226] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:50.500732 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:50.501994 32500 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.504035 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:50.506692 30312 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:50.510663 29644 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260807 15:10:50.511783 32500 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.516528 29637 raft_consensus.cc:1226] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:50.517475 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.517678 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.518599 29641 raft_consensus.cc:2379] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
W20260807 15:10:50.518882 32721 consensus_meta.cc:287] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.567s user 0.014s sys 0.003s
I20260807 15:10:50.519381 32721 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.520386 32700 raft_consensus.cc:3032] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:50.520820 32700 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:50.522330 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 15:10:50.523070 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:50.523988 29563 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 15:10:50.525305 340 consensus_queue.cc:1046] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260807 15:10:50.526257 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 93499.7us
I20260807 15:10:50.527040 340 consensus_queue.cc:1046] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:10:50.527325 29609 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:50.522078 32700 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.527806 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:50.529065 29570 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:50.530072 29569 raft_consensus.cc:1261] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 15:10:50.532498 29565 raft_consensus.cc:1261] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:50.536352 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.535847 29568 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:10:50.561928 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 79841us
I20260807 15:10:50.559340 29452 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:50.547381 30274 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:50.554728 29608 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:50.552644 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:50.547593 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.572082 29561 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:50.586501 32727 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:50.586694 29452 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:50.547456 322 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:50.574944 32721 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:50.546968 32529 raft_consensus.cc:3032] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:10:50.548517 32663 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:50.546643 340 raft_consensus.cc:3032] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:50.592177 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.570910 32683 raft_consensus.cc:2229] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 15:10:50.606935 29608 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:50.602408 29567 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.611963 29567 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.591728 32727 raft_consensus.cc:686] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:50.615513 32727 consensus_queue.cc:237] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.617525 32703 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:50.618168 32703 raft_consensus.cc:686] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:50.593429 32700 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:50.619355 32703 consensus_queue.cc:237] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:50.623399 316 log.cc:924] Time spent T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.053s user 0.000s sys 0.003s
I20260807 15:10:50.626931 32683 raft_consensus.cc:2258] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 15:10:50.632081 29640 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:50.643733 29608 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:50.644857 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 43569.5us
I20260807 15:10:50.643424 32679 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:50.603600 340 raft_consensus.cc:729] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:50.593879 32763 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:50.596067 32529 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:50.658823 29643 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
W20260807 15:10:50.654220 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 50455.9us
I20260807 15:10:50.621156 32751 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260807 15:10:50.667430 321 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:50.668161 321 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:50.668622 321 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:50.669343 29488 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:50.668789 32529 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.670403 32529 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:10:50.672001 349 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.220s user 0.002s sys 0.000s
I20260807 15:10:50.672683 29452 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:50.619728 32765 consensus_queue.cc:1046] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260807 15:10:50.675997 322 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.678911 322 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.644399 333 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:50.680509 333 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:50.681068 333 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:50.684147 32663 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.671492 29488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2682) took 1157 ms. Trace:
I20260807 15:10:50.656612 32762 consensus_queue.cc:1035] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260807 15:10:50.688259 29488 rpcz_store.cc:276] 0807 15:10:49.513857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:49.514016 (+ 159us) service_pool.cc:227] Handling call
0807 15:10:50.671251 (+1157235us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003ae8d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:50.671414 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2337661312}
I20260807 15:10:50.644366 32312 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260807 15:10:50.605228 32696 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:50.705772 29608 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:50.687482 32663 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:50.711021 32708 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:50.711301 330 raft_consensus.cc:2781] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 15:10:50.713697 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 186557us
I20260807 15:10:50.712054 330 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:50.715025 32751 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.730623 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:50.737469 29645 raft_consensus.cc:1226] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:50.742624 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:50.731606 330 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:50.729846 32763 raft_consensus.cc:686] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:50.730593 32708 raft_consensus.cc:686] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:50.752796 29609 leader_election.cc:398] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4.
I20260807 15:10:50.753811 336 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:50.754510 336 raft_consensus.cc:686] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:50.754793 30274 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:50.755635 336 consensus_queue.cc:237] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.757388 32637 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:10:50.758769 30272 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:10:50.753859 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 48209.4us
W20260807 15:10:50.780630 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 52336.8us
I20260807 15:10:50.780633 29646 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 15:10:50.784793 32708 consensus_queue.cc:237] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.787119 32338 consensus_queue.cc:1046] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:50.788242 32338 consensus_queue.cc:1046] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:10:50.789431 32507 raft_consensus.cc:3032] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:50.787140 29568 raft_consensus.cc:1226] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:50.786183 32534 consensus_queue.cc:1046] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:50.790483 29482 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:50.779975 32751 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.789850 32507 raft_consensus.cc:729] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:50.795222 32697 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.799013 30274 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:50.801703 32663 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.789750 331 raft_consensus.cc:3032] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:50.797245 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:50.789932 32685 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:50.811023 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:50.811192 32729 raft_consensus.cc:2781] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:50.795992 32697 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.807512 32288 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.837253 32288 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:50.838475 32703 consensus_queue.cc:1046] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260807 15:10:50.833931 355 log.cc:924] Time spent T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.104s user 0.000s sys 0.001s
I20260807 15:10:50.835254 32748 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260807 15:10:50.804742 331 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:50.812295 32685 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:50.843910 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:50.814536 32729 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 15:10:50.848090 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 53415.6us
I20260807 15:10:50.839608 32288 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:50.779568 340 consensus_queue.cc:260] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.840173 32637 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.839650 32703 raft_consensus.cc:3032] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:10:50.859092 29645 raft_consensus.cc:3032] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:50.861264 29645 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:50.852196 32685 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:50.851516 32729 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:50.796342 32507 consensus_queue.cc:260] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.860707 32703 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:10:50.898936 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 49018.6us
I20260807 15:10:50.860561 32721 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:50.853331 32529 consensus_queue.cc:1046] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260807 15:10:50.905843 32683 ts_tablet_manager.cc:1905] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 15:10:50.908288 32765 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:50.909891 32755 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.910492 32755 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:50.912037 30273 leader_election.cc:334] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.550s (SENT)
I20260807 15:10:50.912578 30273 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:50.914810 331 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.916688 331 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:50.917507 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.920221 32637 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.922638 32637 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:50.922341 330 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.923290 32637 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:50.924150 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 144289us
I20260807 15:10:50.925580 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
W20260807 15:10:50.925822 358 log.cc:924] Time spent T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20260807 15:10:50.926992 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:50.928426 32507 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:50.929427 29645 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.930804 29645 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:50.934530 32697 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:50.843194 32763 consensus_queue.cc:237] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:50.853538 32663 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:50.939919 32751 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:50.941169 361 log.cc:924] Time spent T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260807 15:10:50.941911 32500 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:50.943271 337 raft_consensus.cc:2781] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:50.944484 32500 raft_consensus.cc:686] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:50.945055 29531 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:50.959409 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 56326.4us
I20260807 15:10:50.975248 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:50.975214 29567 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 15:10:50.961406 340 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:50.979598 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:50.981582 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 81537.5us
I20260807 15:10:50.982604 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:50.982807 29570 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:50.983263 29609 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:50.997974 29608 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:50.998802 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:50.999506 29642 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 4
I20260807 15:10:50.996160 29566 raft_consensus.cc:1261] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 15:10:51.002998 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 156690us
I20260807 15:10:51.014878 29643 raft_consensus.cc:1261] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:50.997953 32634 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:50.999218 32708 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.023s
W20260807 15:10:51.020864 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 93995.1us
I20260807 15:10:51.017156 29486 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:50.976385 321 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.029384 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:51.039549 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:50.947913 32703 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.045665 29533 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:50.949617 32500 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.024392 30274 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:51.046653 30306 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:51.026149 32727 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:51.026981 330 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:51.031595 32662 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:51.047220 32663 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:51.019738 32312 consensus_queue.cc:1035] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260807 15:10:51.071874 32684 raft_consensus.cc:2781] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:51.070389 32696 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:51.097306 29486 raft_consensus.cc:1261] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:51.097694 29640 raft_consensus.cc:1226] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:51.044981 32634 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.135128 29482 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:51.140436 29570 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:51.085181 32663 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:51.094080 32684 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 15:10:51.148020 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 122029us
I20260807 15:10:51.154412 29488 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:51.105382 300 raft_consensus.cc:3032] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:51.093616 337 raft_consensus.cc:686] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:51.106357 32529 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:51.161688 29486 raft_consensus.cc:1261] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 15:10:51.175716 29566 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:10:51.155560 32684 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:51.159726 344 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:51.164615 32534 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:51.158501 300 raft_consensus.cc:729] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:51.165439 32637 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:51.206288 32733 consensus_queue.cc:1046] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260807 15:10:51.202936 32662 raft_consensus.cc:686] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
W20260807 15:10:51.206796 365 log.cc:924] Time spent T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.140s user 0.001s sys 0.000s
I20260807 15:10:51.207096 321 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:51.206987 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:51.208240 362 log.cc:924] Time spent T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.251s user 0.000s sys 0.002s
W20260807 15:10:51.209470 366 log.cc:924] Time spent T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260807 15:10:51.209386 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:10:51.258258 333 consensus_meta.cc:287] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.577s user 0.013s sys 0.000s
I20260807 15:10:51.258653 29483 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:51.258859 333 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.209968 29485 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 15:10:51.163568 32679 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260807 15:10:51.213472 377 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 15:10:51.217432 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 43782.6us
W20260807 15:10:51.218297 29450 leader_election.cc:334] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.509s (SENT)
I20260807 15:10:51.167483 32626 consensus_queue.cc:1035] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.196s
I20260807 15:10:51.225817 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:51.197223 32729 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.226910 32733 consensus_queue.cc:1225] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer 4b092f7f951b4137b5d7810056684270 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260807 15:10:51.167689 32727 raft_consensus.cc:686] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:10:51.229496 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 52771.5us
W20260807 15:10:51.230661 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 132049us
I20260807 15:10:51.234556 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.173317 32529 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:51.238274 300 consensus_queue.cc:260] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.201697 32663 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.252907 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.292727 29482 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:51.253362 29566 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 15:10:51.256322 29480 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:51.202112 344 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:51.199774 32755 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:51.269632 29645 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:10:51.262458 32634 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:51.278492 32700 consensus_meta.cc:287] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.623s user 0.009s sys 0.004s
I20260807 15:10:51.283063 29479 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260807 15:10:51.289407 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:51.287753 32534 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:51.293952 30274 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:51.296916 29483 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
I20260807 15:10:51.295845 29640 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:51.249629 32637 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.295789 344 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:51.312016 29488 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 15:10:51.313997 30310 raft_consensus.cc:1261] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:51.314574 30274 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:51.315470 29486 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:51.317137 32634 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:51.317565 32634 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:51.317920 32634 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:51.319494 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.320564 29482 raft_consensus.cc:2379] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 3: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
W20260807 15:10:51.320241 29366 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 00dd11bf8fd9487580aba733c2996a4a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:51.320838 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.321385 32755 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:51.321527 29485 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:51.321971 32755 raft_consensus.cc:686] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 6 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:51.323052 32755 consensus_queue.cc:237] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.311292 32534 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:51.302577 337 consensus_queue.cc:237] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.324293 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.310091 32727 consensus_queue.cc:237] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:51.347378 29485 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260807 15:10:51.347911 29485 pending_rounds.cc:76] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Aborting all ops after (but not including) 4
I20260807 15:10:51.348133 29485 pending_rounds.cc:97] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260807 15:10:51.348665 32729 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:51.348394 29485 raft_consensus.cc:2866] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:10:51.351804 30310 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 7 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:51.353022 29484 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:10:51.355105 32637 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:51.356117 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.356873 29484 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:51.296839 32529 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.336949 29642 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:51.332082 29641 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:51.340420 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.333154 30272 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:51.342031 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:51.342826 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:51.343312 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 125229us
I20260807 15:10:51.343713 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:51.344573 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.345082 30308 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:51.345785 333 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:51.329254 376 log.cc:924] Time spent T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.106s user 0.002s sys 0.000s
I20260807 15:10:51.359547 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:51.341651 374 log.cc:924] Time spent T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.129s user 0.002s sys 0.000s
I20260807 15:10:51.352988 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:51.362540 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:51.374868 29483 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:51.374517 30310 raft_consensus.cc:2362] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3. Re-sending same reply.
I20260807 15:10:51.361545 30306 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:51.362967 30274 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:51.360369 30311 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:51.366531 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:51.370471 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:51.378692 29480 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:51.380221 29482 raft_consensus.cc:1261] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 15:10:51.351806 32663 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:51.368659 32765 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:51.385030 29449 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:51.397207 29450 leader_election.cc:334] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.567s (SENT)
I20260807 15:10:51.398877 30306 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:10:51.297951 32662 consensus_queue.cc:237] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.347462 32679 consensus_queue.cc:1035] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260807 15:10:51.397007 30273 leader_election.cc:334] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.787s (SENT)
I20260807 15:10:51.405798 30307 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 1.
I20260807 15:10:51.380100 32637 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:51.343739 328 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:51.410095 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:51.412082 30273 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:51.372949 32708 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260807 15:10:51.415735 29487 raft_consensus.cc:2379] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 6: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:10:51.393733 32729 raft_consensus.cc:2781] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:51.408739 29450 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:51.400439 300 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:51.418622 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:51.426395 30311 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:51.419375 29569 raft_consensus.cc:1261] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:51.421301 32729 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:51.434618 32729 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:51.429265 32529 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:51.413924 333 raft_consensus.cc:2781] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election won for term 4
W20260807 15:10:51.438061 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 74693.3us
I20260807 15:10:51.413513 32637 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 15:10:51.447311 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 73599.1us
I20260807 15:10:51.404930 32312 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260807 15:10:51.453540 29531 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:51.431236 32748 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:51.436538 32534 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:51.464182 378 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260807 15:10:51.483243 29450 leader_election.cc:334] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.617s (SENT)
I20260807 15:10:51.484161 29450 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:51.486011 29566 raft_consensus.cc:1261] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:51.451838 32637 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:51.408495 32765 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:51.489406 29480 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:51.490026 30306 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:51.452689 333 raft_consensus.cc:686] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:51.436663 32634 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:51.503816 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 119517us
I20260807 15:10:51.503225 32671 raft_consensus.cc:3032] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:51.507006 32671 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:51.506927 344 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:51.508296 32671 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:51.509757 32671 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:51.510294 344 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:51.436743 328 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.512015 30309 raft_consensus.cc:1226] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:51.495198 32666 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:51.488721 32721 raft_consensus.cc:3032] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:51.498615 306 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:51.603268 29645 raft_consensus.cc:1226] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:51.512547 32534 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:10:51.635162 30273 leader_election.cc:334] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.588s (SENT)
I20260807 15:10:51.602470 32721 raft_consensus.cc:729] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:51.653009 32683 ts_tablet_manager.cc:1918] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 15:10:51.653777 32683 log.cc:1196] T 3518672558d94e27a30f3efea0bbeab6 P 9bbe5c211ab64989a57350f34f007ced: Deleting WAL directory at /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/ts-0-root/wals/3518672558d94e27a30f3efea0bbeab6
I20260807 15:10:51.655830 32683 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33668 (request call id 769) took 5354 ms. Trace:
I20260807 15:10:51.658186 32683 rpcz_store.cc:276] 0807 15:10:46.316993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:46.618956 (+301963us) service_pool.cc:227] Handling call
0807 15:10:49.201130 (+2582174us) ts_tablet_manager.cc:1145] Deleting tablet 3518672558d94e27a30f3efea0bbeab6
0807 15:10:49.201195 (+ 65us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 15:10:51.309995 (+2108800us) tablet_metadata.cc:641] Metadata flushed
0807 15:10:51.652686 (+342691us) tablet_metadata.cc:641] Metadata flushed
0807 15:10:51.655715 (+ 3029us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1272879,"tablet-delete.queue_time_us":2539547}
W20260807 15:10:51.662751 32685 consensus_meta.cc:287] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.759s user 0.007s sys 0.010s
I20260807 15:10:51.501293 32684 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.609099 306 raft_consensus.cc:686] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
W20260807 15:10:51.656719 387 log.cc:924] Time spent T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
W20260807 15:10:51.647672 369 log.cc:924] Time spent T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.421s user 0.003s sys 0.000s
W20260807 15:10:51.695282 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 319568us
I20260807 15:10:51.610095 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:51.703408 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 220234us
I20260807 15:10:51.609373 32666 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:51.710568 29450 leader_election.cc:334] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.645s (SENT)
I20260807 15:10:51.711966 29450 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:51.663834 32685 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.722069 32700 consensus_queue.cc:1035] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260807 15:10:51.708169 380 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260807 15:10:51.734900 390 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260807 15:10:51.658209 32729 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:51.791996 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 186539us
W20260807 15:10:51.778895 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 68388.5us
W20260807 15:10:51.770347 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 70687.2us
I20260807 15:10:51.791352 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:51.816884 29640 raft_consensus.cc:2379] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:51.845151 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:51.846235 29483 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 6
W20260807 15:10:51.737219 388 log.cc:924] Time spent T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
W20260807 15:10:51.767982 372 log.cc:924] Time spent T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.149s user 0.007s sys 0.006s
I20260807 15:10:51.854368 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:51.708614 344 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
W20260807 15:10:51.764353 392 log.cc:924] Time spent T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.057s user 0.001s sys 0.000s
I20260807 15:10:51.735951 32685 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:51.737136 389 log.cc:924] Time spent T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
I20260807 15:10:51.705506 32763 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.146s
I20260807 15:10:51.779034 32733 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:51.816591 32696 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:51.718659 30303 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:51.734302 29367 catalog_manager.cc:4841] TS 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125): tablet 3518672558d94e27a30f3efea0bbeab6 (table test-workload [id=31d0d00623fd4306950184679e10f7d3]) successfully deleted
I20260807 15:10:51.853312 32634 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:51.860116 300 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:51.860661 328 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:51.765070 32637 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:51.895651 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 68617.3us
I20260807 15:10:51.855003 32765 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:51.779361 32721 consensus_queue.cc:260] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:51.897071 32733 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:51.762145 306 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.911556 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:51.914376 29367 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 192187us
I20260807 15:10:51.920976 29564 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:51.765822 333 consensus_queue.cc:237] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:51.923049 29566 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:51.932080 29483 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:51.936887 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:51.939955 29450 leader_election.cc:334] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.773s (SENT)
I20260807 15:10:51.939765 32534 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:51.941969 29450 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:51.940878 32534 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:51.915639 32684 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:51.924908 32721 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:51.950616 32637 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:51.950918 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 559707us
I20260807 15:10:51.953823 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:51.954460 29644 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:51.956254 32729 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:51.919633 32765 consensus_queue.cc:1035] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260807 15:10:51.960703 29609 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:51.963133 30311 consensus_meta.cc:287] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.530s user 0.007s sys 0.004s
I20260807 15:10:51.964767 30274 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:51.963689 30311 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:51.918025 300 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:51.981318 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 116974us
I20260807 15:10:51.918744 378 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260807 15:10:51.962414 32626 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:52.004139 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.009671 29479 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:10:52.007862 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 68012.1us
W20260807 15:10:52.015273 29450 leader_election.cc:334] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.780s (SENT)
I20260807 15:10:51.975317 32684 raft_consensus.cc:2781] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:52.006515 379 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:52.020769 29479 raft_consensus.cc:1261] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 15:10:52.023602 393 log.cc:924] Time spent T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.206s user 0.001s sys 0.000s
I20260807 15:10:52.006572 404 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:52.025254 29485 raft_consensus.cc:1261] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:51.971861 32763 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260807 15:10:52.040163 32534 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:52.040802 29609 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:52.044342 29479 raft_consensus.cc:1261] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 15:10:52.045153 300 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:52.045790 300 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:52.046124 300 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:52.046437 300 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:10:52.022264 32671 consensus_meta.cc:287] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.512s user 0.012s sys 0.003s
W20260807 15:10:52.081516 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 74028.5us
I20260807 15:10:52.026357 32684 raft_consensus.cc:686] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:52.093799 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:52.094830 29487 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 15:10:52.095634 400 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:52.098066 411 consensus_queue.cc:1035] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:52.019176 405 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260807 15:10:52.029381 379 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.099987 411 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:52.100593 405 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:52.101087 405 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.101998 379 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:52.102687 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 55145.2us
I20260807 15:10:52.103569 405 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:52.104305 32733 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:52.111531 29644 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
W20260807 15:10:51.922214 328 consensus_queue.cc:1159] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b092f7f951b4137b5d7810056684270" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 15:10:52.133270 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:52.090770 393 log.cc:924] Time spent T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.057s user 0.001s sys 0.000s
I20260807 15:10:52.101996 411 raft_consensus.cc:3032] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:52.150524 29640 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:52.161428 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:52.170827 404 raft_consensus.cc:686] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:52.172384 404 consensus_queue.cc:237] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.148670 411 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:52.178920 411 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:52.167220 409 log.cc:924] Time spent T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260807 15:10:52.168859 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:52.181501 32684 consensus_queue.cc:237] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.131610 300 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.190636 300 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:52.209278 403 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:52.210147 403 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.226133 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:52.227085 403 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:52.234335 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:52.235164 29642 raft_consensus.cc:2379] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 6: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:52.231550 424 consensus_queue.cc:1046] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260807 15:10:52.233067 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:52.237452 30309 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:52.242410 29609 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:52.248996 425 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:52.249562 425 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:52.249930 425 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:52.243012 418 raft_consensus.cc:3032] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:52.253666 418 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:52.261595 418 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.262992 418 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:52.269308 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.270170 29480 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:52.263976 425 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.288655 425 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:52.289884 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:52.290634 30306 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:52.303138 30306 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:52.304893 29609 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:10:52.307575 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 264413us
I20260807 15:10:52.308529 425 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:52.311707 425 raft_consensus.cc:686] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:52.312829 425 consensus_queue.cc:237] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:52.320282 29450 leader_election.cc:334] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.624s (SENT)
I20260807 15:10:52.321014 29450 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.322992 32696 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260807 15:10:52.324666 29450 leader_election.cc:334] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.818s (SENT)
I20260807 15:10:52.326422 29450 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:52.330510 32696 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:52.331583 390 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:52.332250 390 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.342875 390 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:52.345314 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:52.346351 30306 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:10:52.353108 29450 leader_election.cc:334] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.859s (SENT)
I20260807 15:10:52.353708 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.345216 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.356691 29484 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:52.358920 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.362715 29488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2701) took 1128 ms. Trace:
I20260807 15:10:52.363061 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.363873 29609 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:52.365813 29484 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:52.369158 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2829) took 1117 ms. Trace:
I20260807 15:10:52.375142 29609 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:52.372630 29488 rpcz_store.cc:276] 0807 15:10:51.234394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:51.262692 (+ 28298us) service_pool.cc:227] Handling call
0807 15:10:51.276665 (+ 13973us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:51.312478 (+ 35813us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:52.362485 (+1050007us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b5400320854. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:52.362625 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":80413056}
I20260807 15:10:52.377832 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.381579 29484 raft_consensus.cc:1261] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 15:10:52.383332 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:52.384425 29641 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
I20260807 15:10:52.374377 29569 rpcz_store.cc:276] 0807 15:10:51.251967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:51.253735 (+ 1768us) service_pool.cc:227] Handling call
0807 15:10:51.254096 (+ 361us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:51.427367 (+173271us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:52.368863 (+941496us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540022d154. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:52.369058 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":379358464}
I20260807 15:10:52.383952 29486 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:52.387617 32666 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:52.390836 29609 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:52.392532 336 consensus_queue.cc:1035] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:52.395102 336 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:52.395604 336 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:52.397836 336 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:52.384164 424 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:52.400471 404 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:10:52.401191 404 raft_consensus.cc:686] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:52.370033 29480 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:52.409922 32529 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:52.416201 32529 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.402361 404 consensus_queue.cc:237] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.418617 32529 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:52.421988 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50296.6us
W20260807 15:10:52.426419 30273 leader_election.cc:334] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.917s (SENT)
W20260807 15:10:52.431299 30273 leader_election.cc:334] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.042s (SENT)
W20260807 15:10:52.431797 382 log.cc:924] Time spent T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.731s user 0.004s sys 0.000s
W20260807 15:10:52.433897 30273 leader_election.cc:334] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.131s (SENT)
I20260807 15:10:52.463303 418 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:52.464004 418 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.468230 418 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:52.468505 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.469399 29488 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
W20260807 15:10:52.468886 30273 leader_election.cc:334] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.244s (SENT)
I20260807 15:10:52.471675 29609 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:52.478611 29450 leader_election.cc:334] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.680s (SENT)
I20260807 15:10:52.472935 418 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:52.480651 418 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:52.481137 418 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:52.484843 336 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.488539 336 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:52.488619 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.489324 29488 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:52.493044 30310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 820) took 1148 ms. Trace:
I20260807 15:10:52.493494 30310 rpcz_store.cc:276] 0807 15:10:51.345010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:51.397908 (+ 52898us) service_pool.cc:227] Handling call
0807 15:10:52.492135 (+1094227us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5800005198. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d1a2b0 00007f94e0d057f9 00007f94e0d052a2 00007f94da3eb684
0807 15:10:52.492364 (+ 229us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:52.492657 (+ 293us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:52.492696 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:52.492739 (+ 43us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:10:52.492776 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:52.492829 (+ 53us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:52.492949 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4774656}
I20260807 15:10:52.496001 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:52.496735 30310 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:10:52.499567 29450 leader_election.cc:334] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.891s (SENT)
I20260807 15:10:52.500147 29450 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:52.502031 406 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:52.504910 418 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.507239 30310 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:52.499830 29488 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:52.508903 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.509567 29484 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:52.510097 29609 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:52.511045 380 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:10:52.511560 380 raft_consensus.cc:686] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:52.512641 380 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:52.513803 29450 leader_election.cc:334] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.025s (SENT)
I20260807 15:10:52.514268 29450 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:52.515040 406 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:52.516402 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.516999 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.517051 29486 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:52.517496 29484 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:52.517652 29488 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:52.518551 29452 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.519116 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.519712 29480 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:52.521445 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.522205 29484 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:52.523310 29484 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:10:52.524600 30273 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.526551 414 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:52.525607 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:52.527441 414 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:52.526454 321 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:52.528532 414 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.526552 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:52.532516 29609 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:52.532351 321 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.534504 321 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:52.526126 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:52.536688 404 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:52.527226 32684 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 15:10:52.538775 404 raft_consensus.cc:686] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:52.526695 32666 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:52.536607 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:52.562402 29486 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:52.563494 418 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:52.565584 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.567090 30274 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.568349 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.542282 30309 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260807 15:10:52.569357 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:52.571002 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:10:52.548271 29564 consensus_meta.cc:287] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.624s user 0.013s sys 0.000s
I20260807 15:10:52.549773 29488 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:52.574422 29564 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:52.550722 377 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:52.543877 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.568554 403 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:52.577864 403 raft_consensus.cc:686] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:52.578913 403 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:52.539597 29450 leader_election.cc:334] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.052s (SENT)
W20260807 15:10:52.581079 29450 leader_election.cc:334] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.115s (SENT)
W20260807 15:10:52.581401 29483 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.571s user 0.004s sys 0.002s
W20260807 15:10:52.581808 29483 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.572s user 0.005s sys 0.002s
I20260807 15:10:52.583253 29645 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:52.542902 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:52.584769 30310 raft_consensus.cc:2379] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 3: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:52.581482 29450 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.585745 404 consensus_queue.cc:237] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:52.589704 29450 leader_election.cc:334] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.120s (SENT)
I20260807 15:10:52.593122 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2833) took 1282 ms. Trace:
I20260807 15:10:52.592469 29450 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.595834 370 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:52.596334 32529 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:52.596431 370 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.589720 32705 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:52.598553 370 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:52.601797 411 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:52.610154 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:52.573714 29486 raft_consensus.cc:1226] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:52.616226 32705 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:52.616427 426 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:52.616868 29642 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:10:52.593602 29565 rpcz_store.cc:276] 0807 15:10:51.310828 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:51.311432 (+ 604us) service_pool.cc:227] Handling call
0807 15:10:51.311844 (+ 412us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 15:10:51.366394 (+ 54550us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:51.366426 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 15:10:51.387986 (+ 21560us) log.cc:842] Serialized 52 byte log entry
0807 15:10:51.600432 (+212446us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:10:51.609707 (+ 9275us) log.cc:842] Serialized 14 byte log entry
0807 15:10:51.610245 (+ 538us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:51.610331 (+ 86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:52.592891 (+982560us) raft_consensus.cc:1671] finished
0807 15:10:52.592913 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:52.593061 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24623,"prepare.queue_time_us":112189,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":26400,"raft.queue_time_us":61644,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":31711,"thread_start_us":157898,"threads_started":1,"wal-append.queue_time_us":272558}
I20260807 15:10:52.620026 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:52.622463 29450 leader_election.cc:334] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.191s (SENT)
I20260807 15:10:52.623041 370 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 15:10:52.623631 29481 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.519s user 0.006s sys 0.003s
W20260807 15:10:52.628486 29481 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.542s user 0.008s sys 0.003s
I20260807 15:10:52.631791 29480 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:52.634580 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2827) took 1472 ms. Trace:
I20260807 15:10:52.634989 29570 rpcz_store.cc:276] 0807 15:10:51.162486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:51.174088 (+ 11602us) service_pool.cc:227] Handling call
0807 15:10:51.202476 (+ 28388us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:51.232678 (+ 30202us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:51.232722 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:51.248924 (+ 16202us) log.cc:842] Serialized 26 byte log entry
0807 15:10:51.444914 (+195990us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:51.444952 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:51.445026 (+ 74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:52.431098 (+986072us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:10:52.631711 (+200613us) raft_consensus.cc:1671] finished
0807 15:10:52.631734 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:52.634509 (+ 2775us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22386,"raft.queue_time_us":33209,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"spinlock_wait_cycles":8842624,"thread_start_us":146925,"threads_started":1,"wal-append.queue_time_us":368395}
I20260807 15:10:52.637889 32666 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:10:52.640144 30310 raft_consensus.cc:1261] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:52.642227 29380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 219) took 9986 ms. Trace:
I20260807 15:10:52.642620 29380 rpcz_store.cc:276] 0807 15:10:42.655839 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.843945 (+188106us) service_pool.cc:227] Handling call
0807 15:10:52.641999 (+9798054us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:49.816897 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:49.952010 (+135113us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:49.953968 (+ 1958us) write_op.cc:435] Acquired schema lock
0807 15:10:49.960248 (+ 6280us) tablet.cc:660] Decoding operations
0807 15:10:50.091044 (+130796us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:50.091161 (+ 117us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:50.091201 (+ 40us) tablet.cc:683] Acquiring locks for 4 operations
0807 15:10:50.091660 (+ 459us) tablet.cc:699] Row locks acquired
0807 15:10:50.091681 (+ 21us) write_op.cc:260] PREPARE: finished
0807 15:10:50.091874 (+ 193us) write_op.cc:270] Start()
0807 15:10:50.092059 (+ 185us) write_op.cc:276] Timestamp: P: 1786115450091805 usec, L: 0
0807 15:10:50.092093 (+ 34us) op_driver.cc:331] REPLICATION: starting
0807 15:10:50.111983 (+ 19890us) log.cc:842] Serialized 1698 byte log entry
0807 15:10:50.792206 (+680223us) op_driver.cc:444] REPLICATION: finished
0807 15:10:50.995973 (+203767us) write_op.cc:301] APPLY: starting
0807 15:10:50.996130 (+ 157us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:51.022071 (+ 25941us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:51.053373 (+ 31302us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:51.218439 (+165066us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:51.218862 (+ 423us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 15:10:51.218911 (+ 49us) write_op.cc:312] APPLY: finished
0807 15:10:51.219439 (+ 528us) log.cc:842] Serialized 41 byte log entry
0807 15:10:51.219657 (+ 218us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:51.219857 (+ 200us) write_op.cc:454] Released schema lock
0807 15:10:51.219945 (+ 88us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:51.220489 (+ 544us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:51.220529 (+ 40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7459,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":181071,"apply.run_cpu_time_us":5199,"apply.run_wall_time_us":238814,"num_ops":4,"prepare.queue_time_us":180856,"prepare.run_cpu_time_us":9794,"prepare.run_wall_time_us":488626,"raft.queue_time_us":282380,"raft.run_cpu_time_us":41816,"raft.run_wall_time_us":96243,"replication_time_us":677743,"thread_start_us":534789,"threads_started":4,"wal-append.queue_time_us":155574,"wal-append.run_cpu_time_us":73255,"wal-append.run_wall_time_us":1913205}]]}
I20260807 15:10:52.647750 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:52.652031 30309 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 7. Ops: []
I20260807 15:10:52.648162 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.648865 32703 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:52.651526 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:10:52.623875 29450 leader_election.cc:334] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.081s (SENT)
I20260807 15:10:52.660444 29450 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:52.662294 348 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:52.673005 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:52.676213 405 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:52.676728 376 log.cc:924] Time spent T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.796s user 0.003s sys 0.000s
I20260807 15:10:52.690428 405 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.691661 344 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:52.679474 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 55640.9us
I20260807 15:10:52.695415 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:52.696375 29488 raft_consensus.cc:2354] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5.
W20260807 15:10:52.698062 29450 leader_election.cc:334] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.225s (SENT)
I20260807 15:10:52.682967 29486 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:52.681113 30274 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:52.627946 29479 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 7. Ops: []
I20260807 15:10:52.685341 29480 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:52.687271 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:52.688000 391 log.cc:924] Time spent T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.995s user 0.002s sys 0.002s
I20260807 15:10:52.706382 29488 raft_consensus.cc:1226] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 6. Ops: []
I20260807 15:10:52.714658 29570 raft_consensus.cc:1226] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:52.721042 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:52.722375 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:52.879428 29560 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:52.879709 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2832) took 1569 ms. Trace:
I20260807 15:10:52.880430 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:52.722661 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:52.723948 29450 leader_election.cc:334] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.226s (SENT)
I20260807 15:10:52.881459 29564 raft_consensus.cc:2379] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:52.881371 29450 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.729072 29486 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:10:52.732745 29569 raft_consensus.cc:1261] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 15:10:52.882746 29569 pending_rounds.cc:76] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Aborting all ops after (but not including) 2
I20260807 15:10:52.883019 29569 pending_rounds.cc:97] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 15:10:52.883276 29569 raft_consensus.cc:2866] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:10:52.735018 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:52.747813 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:52.884881 29567 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:52.749431 29568 raft_consensus.cc:1203] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.5->[6.6-6.6] Dedup: 6.6->[]
I20260807 15:10:52.749724 29563 raft_consensus.cc:1226] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:52.885735 29568 raft_consensus.cc:1226] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260807 15:10:52.748692 430 consensus_queue.cc:1035] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260807 15:10:52.764142 29533 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59890 dropped due to backpressure. The service queue is full; it has 50 items.
I20260807 15:10:52.779071 32696 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:10:52.823251 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 142230us
I20260807 15:10:52.831303 32529 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:52.835530 32666 raft_consensus.cc:2781] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:52.838554 328 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:52.871942 29479 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260807 15:10:52.914592 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 190699us
I20260807 15:10:52.880111 29561 rpcz_store.cc:276] 0807 15:10:51.310522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:51.327187 (+ 16665us) service_pool.cc:227] Handling call
0807 15:10:51.327682 (+ 495us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:51.367866 (+ 40184us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:51.367933 (+ 67us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:51.368452 (+ 519us) log.cc:842] Serialized 26 byte log entry
0807 15:10:51.450078 (+ 81626us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:51.450123 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:51.451827 (+ 1704us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:52.539445 (+1087618us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b48001701d8. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e0c6b7f1 00007f94e0c628e7 00007f94e0c6277a 00007f94e0d5695f 00007f94e0d56627 00007f94e0d6ab2c 00007f94e0d6aad8 00007f94e0d6aa58 00007f94e0d6aa13 00007f94e0d69cbc 00007f94dfcebbe6
0807 15:10:52.687208 (+147763us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:10:52.879486 (+192278us) raft_consensus.cc:1671] finished
0807 15:10:52.879507 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:52.879632 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29090,"raft.queue_time_us":38062,"raft.run_cpu_time_us":3649,"raft.run_wall_time_us":1159176,"spinlock_wait_cycles":61555840,"thread_start_us":44962,"threads_started":1,"wal-append.queue_time_us":211185}
I20260807 15:10:52.913578 328 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:52.920781 328 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:52.912237 32529 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.922708 32529 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:52.925310 29560 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:52.929744 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:52.910267 32705 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:52.911284 29533 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59890 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2154)
I20260807 15:10:52.941829 30274 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:10:52.939563 463 log.cc:924] Time spent T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260807 15:10:52.944609 32666 raft_consensus.cc:686] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:52.970554 32666 consensus_queue.cc:237] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.954079 32637 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:52.972970 29450 leader_election.cc:334] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.246s (SENT)
I20260807 15:10:52.973419 29450 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:52.971128 29533 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59890 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2154)
I20260807 15:10:52.975723 29485 raft_consensus.cc:1261] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 15:10:52.979389 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:52.972404 32637 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:52.983587 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:52.984524 29565 raft_consensus.cc:2354] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:52.954062 403 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:52.977545 321 raft_consensus.cc:2781] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:53.022586 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.023813 29565 raft_consensus.cc:2379] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:52.985123 300 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260807 15:10:53.006078 430 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 15:10:53.024333 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 65878us
I20260807 15:10:53.025662 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.026486 29565 raft_consensus.cc:2379] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:53.027280 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.028029 29565 raft_consensus.cc:2379] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:53.007138 403 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.034615 32637 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:53.038291 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:53.028976 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.041283 29565 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:53.048847 405 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:53.053357 403 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:53.053627 29643 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:53.058952 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:53.065812 29643 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:53.055594 29533 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59890 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2152)
W20260807 15:10:53.069180 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 63619.8us
W20260807 15:10:53.072345 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 125197us
I20260807 15:10:53.075271 30274 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:53.177176 29643 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260807 15:10:53.122411 29450 leader_election.cc:334] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.048s (SENT)
I20260807 15:10:53.074751 403 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260807 15:10:53.189471 29565 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:53.206396 29643 pending_rounds.cc:76] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Aborting all ops after (but not including) 5
I20260807 15:10:53.210507 29450 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:53.090873 321 raft_consensus.cc:686] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:53.095520 29533 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59890 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2146)
W20260807 15:10:53.209452 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 136293us
I20260807 15:10:53.216991 29480 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 15:10:53.236073 30274 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:53.218108 29488 raft_consensus.cc:1261] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 15:10:53.238389 32666 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:10:53.214262 472 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:10:53.094327 32679 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:53.254753 32529 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:53.254595 32679 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.255393 32529 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:53.258059 32529 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:53.243996 29643 pending_rounds.cc:97] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260807 15:10:53.246618 30273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.720s (SENT) [suppressed 61 similar messages]
I20260807 15:10:53.253604 337 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:53.253814 348 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:10:53.073110 405 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.185s
I20260807 15:10:53.268863 32727 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260807 15:10:53.275454 337 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:53.277642 337 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:10:53.278302 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:53.280444 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:53.280900 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:53.286664 472 raft_consensus.cc:686] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:53.289572 29486 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:53.243186 321 consensus_queue.cc:237] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.264204 403 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:10:53.258760 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2146)
I20260807 15:10:53.267935 32637 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:10:53.268332 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 145965us
I20260807 15:10:53.268863 30304 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 15:10:53.269071 336 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:10:53.270267 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:53.300832 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2133)
I20260807 15:10:53.313409 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:53.312182 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:53.316906 30274 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:53.400760 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 83956.3us
I20260807 15:10:53.403371 32679 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:53.262477 424 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260807 15:10:53.281009 29533 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59890 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2133)
I20260807 15:10:53.302521 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:53.422458 30310 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:10:53.422588 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 118346us
W20260807 15:10:53.423448 29450 leader_election.cc:334] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.349s (SENT)
I20260807 15:10:53.287941 472 consensus_queue.cc:237] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.311072 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2133)
W20260807 15:10:53.418363 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 171767us
I20260807 15:10:53.271478 29643 raft_consensus.cc:2866] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 15:10:53.427253 29450 leader_election.cc:334] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.934s (SENT)
I20260807 15:10:53.428411 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:53.442942 29480 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:53.444842 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:53.446009 32679 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:53.450292 32679 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:53.454089 32679 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:53.457931 30310 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:10:53.307770 32637 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.394311 471 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260807 15:10:53.494128 471 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:53.495013 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
W20260807 15:10:53.507212 29641 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s user 0.009s sys 0.024s
W20260807 15:10:53.507822 29641 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s user 0.011s sys 0.025s
I20260807 15:10:53.527321 29450 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:53.499725 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.458535 29533 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59890 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 836)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
I20260807 15:10:53.530134 29560 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:10:53.532358 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2850)
I20260807 15:10:53.543476 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
W20260807 15:10:53.555191 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 128243us
I20260807 15:10:53.451154 32626 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
W20260807 15:10:53.570896 475 log.cc:924] Time spent T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
W20260807 15:10:53.576481 477 log.cc:924] Time spent T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.059s user 0.000s sys 0.001s
I20260807 15:10:53.541643 422 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:53.578167 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.580948 29560 raft_consensus.cc:2379] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:10:53.562668 30273 leader_election.cc:334] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.513s (SENT)
I20260807 15:10:53.631958 30273 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:53.564177 332 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260807 15:10:53.648499 306 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:53.692934 32679 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.678442 321 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:10:53.562263 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2132)
W20260807 15:10:53.704140 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 156936us
W20260807 15:10:53.706979 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 150249us
W20260807 15:10:53.708565 30273 leader_election.cc:334] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.613s (SENT)
W20260807 15:10:53.726168 30273 leader_election.cc:334] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.875s (SENT)
I20260807 15:10:53.726999 30273 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:53.681507 306 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:53.734294 32679 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:53.735668 306 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:53.724880 32700 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:53.720556 29591 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9420 after lost signal to thread 28230
I20260807 15:10:53.736373 32700 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.738554 32700 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:53.738456 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:53.741380 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:53.742472 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:53.744009 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.745177 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.745834 29564 raft_consensus.cc:2354] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:53.746532 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.728155 486 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:53.754561 483 log.cc:924] Time spent T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.301s user 0.002s sys 0.000s
I20260807 15:10:53.761937 30311 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:53.764243 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:53.764663 30306 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 15:10:53.775166 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:53.765349 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:53.765383 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:53.747283 29564 raft_consensus.cc:2396] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260807 15:10:53.766544 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:53.733647 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59890 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
I20260807 15:10:53.795415 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:53.781433 32637 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:53.788044 30305 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:53.788407 30304 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:53.820601 336 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:53.821524 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:53.822125 336 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:10:53.822422 405 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:10:53.823606 29609 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:53.827538 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:53.836894 29645 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.210s user 0.008s sys 0.001s
I20260807 15:10:53.837329 30274 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:53.838299 29532 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. [suppressed 12 similar messages]
I20260807 15:10:53.826526 411 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:10:53.839020 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2856)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2858)
I20260807 15:10:53.848114 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.848884 29564 raft_consensus.cc:2362] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2. Re-sending same reply.
I20260807 15:10:53.849864 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.850512 29564 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:53.849699 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2856)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2857)
I20260807 15:10:53.843240 411 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:53.854910 411 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:10:53.856315 32637 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:10:53.859243 29645 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.232s user 0.008s sys 0.001s
I20260807 15:10:53.860181 29645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2507) took 1235 ms. Trace:
I20260807 15:10:53.860538 29645 rpcz_store.cc:276] 0807 15:10:52.625017 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:52.625226 (+ 209us) service_pool.cc:227] Handling call
0807 15:10:52.625632 (+ 406us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:52.626244 (+ 612us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:52.626273 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:52.626707 (+ 434us) log.cc:842] Serialized 26 byte log entry
0807 15:10:53.859736 (+1233029us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:53.859795 (+ 59us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:53.859885 (+ 90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:53.859964 (+ 79us) raft_consensus.cc:1671] finished
0807 15:10:53.859989 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:53.860125 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":1232676,"threads_started":1,"wal-append.queue_time_us":106852,"wal-append.run_cpu_time_us":1881,"wal-append.run_wall_time_us":1006970}
I20260807 15:10:53.861632 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.862452 29560 raft_consensus.cc:2354] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:53.862859 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2135) took 1112 ms. Trace:
I20260807 15:10:53.856807 29532 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59874 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 2862)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2856)
I20260807 15:10:53.863137 29560 rpcz_store.cc:276] 0807 15:10:52.750453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.861343 (+1110890us) service_pool.cc:227] Handling call
0807 15:10:53.862802 (+ 1459us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.864020 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.870846 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2161) took 1114 ms. Trace:
I20260807 15:10:53.871248 29568 rpcz_store.cc:276] 0807 15:10:52.756657 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:52.886684 (+130027us) service_pool.cc:227] Handling call
0807 15:10:53.863845 (+977161us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b5800004598. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:53.870752 (+ 6907us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":147083136}
I20260807 15:10:53.833287 405 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:53.880959 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.879343 29564 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:53.884361 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.885107 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.885426 29568 raft_consensus.cc:2396] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260807 15:10:53.863828 411 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.885829 29570 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:53.885119 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2149) took 1131 ms. Trace:
I20260807 15:10:52.692747 344 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:53.888367 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2156) took 1133 ms. Trace:
I20260807 15:10:53.905419 29564 rpcz_store.cc:276] 0807 15:10:52.753436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.849577 (+1096141us) service_pool.cc:227] Handling call
0807 15:10:53.885031 (+ 35454us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.905627 29568 rpcz_store.cc:276] 0807 15:10:52.755178 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.874480 (+1119302us) service_pool.cc:227] Handling call
0807 15:10:53.888294 (+ 13814us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.895123 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.906973 29567 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:53.897710 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.900269 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2141) took 1148 ms. Trace:
I20260807 15:10:53.908417 29570 rpcz_store.cc:276] 0807 15:10:52.751487 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:52.882809 (+131322us) service_pool.cc:227] Handling call
0807 15:10:53.884934 (+1002125us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5800004598. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:53.900179 (+ 15245us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":48887040}
I20260807 15:10:53.880659 405 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:53.894138 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.901535 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2176) took 1139 ms. Trace:
I20260807 15:10:53.949651 29560 rpcz_store.cc:276] 0807 15:10:52.761854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.867881 (+1106027us) service_pool.cc:227] Handling call
0807 15:10:53.901447 (+ 33566us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.892266 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2745) took 1019 ms. Trace:
I20260807 15:10:53.908033 29565 raft_consensus.cc:2362] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4. Re-sending same reply.
I20260807 15:10:53.944042 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.945086 411 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:53.946029 344 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:53.946712 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.951313 29646 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:53.948405 29642 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:53.980639 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.972441 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:53.981462 29560 raft_consensus.cc:2354] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:53.981709 30309 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 8
I20260807 15:10:53.981882 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2167) took 1223 ms. Trace:
I20260807 15:10:53.982235 29560 rpcz_store.cc:276] 0807 15:10:52.758301 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.965893 (+1207592us) service_pool.cc:227] Handling call
0807 15:10:53.981826 (+ 15933us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.983008 29568 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:53.983453 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2166) took 1225 ms. Trace:
I20260807 15:10:53.983727 29568 rpcz_store.cc:276] 0807 15:10:52.758005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.906609 (+1148604us) service_pool.cc:227] Handling call
0807 15:10:53.983401 (+ 76792us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.950392 29482 rpcz_store.cc:276] 0807 15:10:52.872838 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:52.873418 (+ 580us) service_pool.cc:227] Handling call
0807 15:10:52.873716 (+ 298us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:52.916381 (+ 42665us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 15:10:52.940102 (+ 23721us) log.cc:842] Serialized 14 byte log entry
0807 15:10:52.959442 (+ 19340us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:52.959515 (+ 73us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:52.959588 (+ 73us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:53.891965 (+932377us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b54001829d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:53.892026 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:53.892177 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19047,"prepare.queue_time_us":23390,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":2813,"raft.queue_time_us":20391,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":97549696}
I20260807 15:10:53.951568 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2163) took 1194 ms. Trace:
I20260807 15:10:53.986650 29565 rpcz_store.cc:276] 0807 15:10:52.757178 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.897327 (+1140149us) service_pool.cc:227] Handling call
0807 15:10:53.951510 (+ 54183us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.978237 29484 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:53.952015 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:53.954725 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2151) took 1200 ms. Trace:
I20260807 15:10:53.989473 30306 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:10:53.991151 29567 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:53.991775 29479 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260807 15:10:53.991839 29567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2170) took 1232 ms (client timeout 1624 ms). Trace:
I20260807 15:10:53.968818 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:53.993180 29567 rpcz_store.cc:269] 0807 15:10:52.759318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:52.885634 (+126316us) service_pool.cc:227] Handling call
0807 15:10:53.894943 (+1009309us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b5800004598. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:53.991729 (+ 96786us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":118207744}
I20260807 15:10:53.994827 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.994903 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:53.995749 29561 raft_consensus.cc:2354] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:53.996206 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2155) took 1241 ms. Trace:
I20260807 15:10:53.996611 29561 rpcz_store.cc:276] 0807 15:10:52.754908 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.994621 (+1239713us) service_pool.cc:227] Handling call
0807 15:10:53.996151 (+ 1530us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.992588 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2153) took 1238 ms. Trace:
I20260807 15:10:53.998656 29570 rpcz_store.cc:276] 0807 15:10:52.754406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.909181 (+1154775us) service_pool.cc:227] Handling call
0807 15:10:53.992529 (+ 83348us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.999714 29564 raft_consensus.cc:2379] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:54.000393 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2192) took 1029 ms. Trace:
I20260807 15:10:54.000792 29564 rpcz_store.cc:276] 0807 15:10:52.970595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.967585 (+996990us) service_pool.cc:227] Handling call
0807 15:10:54.000312 (+ 32727us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:53.989432 29566 rpcz_store.cc:276] 0807 15:10:52.753905 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:52.885165 (+131260us) service_pool.cc:227] Handling call
0807 15:10:53.893922 (+1008757us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b5800004598. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:53.954667 (+ 60745us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":147928832}
I20260807 15:10:54.002583 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:53.995721 29567 raft_consensus.cc:2354] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:54.007263 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2136) took 1256 ms. Trace:
I20260807 15:10:54.008991 29567 rpcz_store.cc:276] 0807 15:10:52.750623 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.994545 (+1243922us) service_pool.cc:227] Handling call
0807 15:10:54.007180 (+ 12635us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.010421 29566 raft_consensus.cc:2396] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260807 15:10:54.012511 29609 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:53.954248 405 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:54.016613 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2186) took 1047 ms. Trace:
I20260807 15:10:53.989363 32765 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:54.017733 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.025558 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.026800 29570 raft_consensus.cc:2354] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:54.027344 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2168) took 1268 ms. Trace:
I20260807 15:10:54.027638 29570 rpcz_store.cc:276] 0807 15:10:52.758620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.999540 (+1240920us) service_pool.cc:227] Handling call
0807 15:10:54.027288 (+ 27748us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:10:54.028316 30273 leader_election.cc:334] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.532s (SENT)
I20260807 15:10:54.028497 424 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:54.028934 424 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:54.029263 424 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:54.028523 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.032584 29570 raft_consensus.cc:2354] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:54.033011 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2142) took 1281 ms. Trace:
I20260807 15:10:54.033557 29570 rpcz_store.cc:276] 0807 15:10:52.751656 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.028265 (+1276609us) service_pool.cc:227] Handling call
0807 15:10:54.032937 (+ 4672us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.034690 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.035427 29570 raft_consensus.cc:2354] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6.
I20260807 15:10:54.035858 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2171) took 1276 ms. Trace:
I20260807 15:10:54.038136 29570 rpcz_store.cc:276] 0807 15:10:52.759650 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.034327 (+1274677us) service_pool.cc:227] Handling call
0807 15:10:54.035814 (+ 1487us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.022703 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.039477 29561 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:54.039618 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.039990 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2131) took 1290 ms. Trace:
I20260807 15:10:54.040308 29561 rpcz_store.cc:276] 0807 15:10:52.749461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.997305 (+1247844us) service_pool.cc:227] Handling call
0807 15:10:54.039936 (+ 42631us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.041466 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.042575 29561 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:54.046799 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2145) took 1294 ms. Trace:
I20260807 15:10:54.048419 29561 rpcz_store.cc:276] 0807 15:10:52.752401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.041068 (+1288667us) service_pool.cc:227] Handling call
0807 15:10:54.046744 (+ 5676us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.040410 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2139) took 1289 ms. Trace:
I20260807 15:10:54.052249 29570 rpcz_store.cc:276] 0807 15:10:52.751140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.039372 (+1288232us) service_pool.cc:227] Handling call
0807 15:10:54.040364 (+ 992us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.020176 29566 rpcz_store.cc:276] 0807 15:10:52.968743 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.002238 (+1033495us) service_pool.cc:227] Handling call
0807 15:10:54.016479 (+ 14241us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.053566 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.009574 32666 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260807 15:10:54.054538 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.055814 29570 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:54.019078 32684 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260807 15:10:54.056365 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2178) took 1293 ms. Trace:
I20260807 15:10:54.056710 29570 rpcz_store.cc:276] 0807 15:10:52.762629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.052883 (+1290254us) service_pool.cc:227] Handling call
0807 15:10:54.056291 (+ 3408us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:10:54.057222 479 log.cc:924] Time spent T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.478s user 0.001s sys 0.000s
I20260807 15:10:54.057529 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.058331 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2179) took 1295 ms. Trace:
I20260807 15:10:54.058617 29570 rpcz_store.cc:276] 0807 15:10:52.763008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.057288 (+1294280us) service_pool.cc:227] Handling call
0807 15:10:54.058247 (+ 959us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.059410 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.060837 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2183) took 1093 ms. Trace:
I20260807 15:10:54.061182 29570 rpcz_store.cc:276] 0807 15:10:52.967780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.059182 (+1091402us) service_pool.cc:227] Handling call
0807 15:10:54.060788 (+ 1606us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.063565 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.068759 29570 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:54.071753 29591 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe6a0 after lost signal to thread 29417
I20260807 15:10:54.057261 32765 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:54.072359 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.073046 29565 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:54.075503 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.076238 29560 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:54.076673 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 835) took 1022 ms. Trace:
I20260807 15:10:54.077005 29560 rpcz_store.cc:276] 0807 15:10:53.054177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.075201 (+1021024us) service_pool.cc:227] Handling call
0807 15:10:54.076617 (+ 1416us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.078107 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.079043 29560 raft_consensus.cc:2396] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260807 15:10:54.081733 30309 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:10:54.019557 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.082953 29564 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:54.083408 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2169) took 1324 ms. Trace:
I20260807 15:10:54.083685 29564 rpcz_store.cc:276] 0807 15:10:52.759008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.001595 (+1242587us) service_pool.cc:227] Handling call
0807 15:10:54.083356 (+ 81761us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.038938 29567 raft_consensus.cc:2396] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260807 15:10:54.084656 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2172) took 1324 ms. Trace:
I20260807 15:10:54.084997 29567 rpcz_store.cc:276] 0807 15:10:52.759969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.011077 (+1251108us) service_pool.cc:227] Handling call
0807 15:10:54.084602 (+ 73525us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.088163 29609 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:54.089136 32708 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:10:54.089699 32708 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:53.996260 484 consensus_queue.cc:1046] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260807 15:10:54.090669 32708 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:54.091398 29450 leader_election.cc:334] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 3.059s (SENT)
I20260807 15:10:54.093081 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.094086 29479 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:54.098136 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2182) took 1130 ms. Trace:
I20260807 15:10:54.098703 29560 rpcz_store.cc:276] 0807 15:10:52.967393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.077776 (+1110383us) service_pool.cc:227] Handling call
0807 15:10:54.098079 (+ 20303us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:10:54.099982 29591 debug-util.cc:398] Leaking SignalData structure 0x7b08000c99c0 after lost signal to thread 29514
I20260807 15:10:54.100139 29482 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260807 15:10:54.100445 29591 debug-util.cc:398] Leaking SignalData structure 0x7b08001baa20 after lost signal to thread 29515
I20260807 15:10:54.101174 29609 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:10:54.101603 29591 debug-util.cc:398] Leaking SignalData structure 0x7b0800367700 after lost signal to thread 29594
W20260807 15:10:54.101936 29591 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec640 after lost signal to thread 29595
I20260807 15:10:54.102417 344 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:54.102807 344 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:54.103145 344 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:54.104053 32765 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:54.107092 29382 catalog_manager.cc:5495] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 5 to 7, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 7 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:54.109539 29382 catalog_manager.cc:5495] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:54.110149 32666 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:10:54.112668 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:54.113605 29563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2137) took 1362 ms (client timeout 1645 ms). Trace:
I20260807 15:10:54.111662 29382 catalog_manager.cc:5495] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 5 to 6, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 6 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
W20260807 15:10:54.116789 30273 leader_election.cc:334] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.662s (SENT)
I20260807 15:10:54.100045 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:54.113982 29563 rpcz_store.cc:269] 0807 15:10:52.750795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:52.886132 (+135337us) service_pool.cc:227] Handling call
0807 15:10:54.112482 (+1226350us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b5800004598. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:54.113546 (+ 1064us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":159087360}
I20260807 15:10:54.119333 29646 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:54.119699 29560 raft_consensus.cc:2396] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260807 15:10:54.120185 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2193) took 1111 ms. Trace:
I20260807 15:10:54.120468 29560 rpcz_store.cc:276] 0807 15:10:53.008475 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.099776 (+1091301us) service_pool.cc:227] Handling call
0807 15:10:54.120121 (+ 20345us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.121304 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.122372 29560 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:54.123004 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 837) took 1068 ms. Trace:
I20260807 15:10:54.086802 29565 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:54.125211 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2147) took 1372 ms. Trace:
I20260807 15:10:54.126523 29565 rpcz_store.cc:276] 0807 15:10:52.752945 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.072059 (+1319114us) service_pool.cc:227] Handling call
0807 15:10:54.125139 (+ 53080us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.127615 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.125790 29560 rpcz_store.cc:276] 0807 15:10:53.054841 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.121065 (+1066224us) service_pool.cc:227] Handling call
0807 15:10:54.122942 (+ 1877us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.128671 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.130105 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.130445 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.131562 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2173) took 1371 ms. Trace:
I20260807 15:10:54.132058 29561 rpcz_store.cc:276] 0807 15:10:52.760603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.052339 (+1291736us) service_pool.cc:227] Handling call
0807 15:10:54.131500 (+ 79161us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.133020 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.134303 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.135705 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.134905 29563 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:54.138895 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2189) took 1169 ms. Trace:
I20260807 15:10:54.139317 29563 rpcz_store.cc:276] 0807 15:10:52.969707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.119551 (+1149844us) service_pool.cc:227] Handling call
0807 15:10:54.138818 (+ 19267us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.141700 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2181) took 1378 ms. Trace:
I20260807 15:10:54.142165 29567 rpcz_store.cc:276] 0807 15:10:52.763722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.085628 (+1321906us) service_pool.cc:227] Handling call
0807 15:10:54.141627 (+ 55999us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.143415 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2191) took 1173 ms. Trace:
I20260807 15:10:54.143962 29565 rpcz_store.cc:276] 0807 15:10:52.970295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.127322 (+1157027us) service_pool.cc:227] Handling call
0807 15:10:54.143335 (+ 16013us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.140971 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2150) took 1387 ms. Trace:
I20260807 15:10:54.147498 29564 rpcz_store.cc:276] 0807 15:10:52.753673 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.084305 (+1330632us) service_pool.cc:227] Handling call
0807 15:10:54.140888 (+ 56583us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.149636 29570 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:10:54.150231 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2157) took 1394 ms. Trace:
I20260807 15:10:54.146373 29566 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:54.158659 29570 rpcz_store.cc:276] 0807 15:10:52.755464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.063337 (+1307873us) service_pool.cc:227] Handling call
0807 15:10:54.150167 (+ 86830us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.158049 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2148) took 1404 ms. Trace:
I20260807 15:10:54.162475 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.164477 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.165819 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.163493 29567 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:54.173087 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.173385 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.162160 29566 rpcz_store.cc:276] 0807 15:10:52.753193 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.053326 (+1300133us) service_pool.cc:227] Handling call
0807 15:10:54.157972 (+104646us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.176883 29563 raft_consensus.cc:2396] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260807 15:10:54.196105 29570 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:54.197288 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.198237 29570 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:54.199186 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.202641 29642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35570 (request call id 645) took 1164 ms. Trace:
I20260807 15:10:54.203215 29642 rpcz_store.cc:276] 0807 15:10:53.037743 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:53.037964 (+ 221us) service_pool.cc:227] Handling call
0807 15:10:54.202372 (+1164408us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540039f654. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:54.202524 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2091293056}
I20260807 15:10:54.206966 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.209277 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.198750 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2143) took 1446 ms. Trace:
I20260807 15:10:54.219151 29570 rpcz_store.cc:276] 0807 15:10:52.751814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.197040 (+1445226us) service_pool.cc:227] Handling call
0807 15:10:54.198655 (+ 1615us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.217721 29569 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:10:54.153648 370 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:54.224619 29569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2160) took 1468 ms (client timeout 1617 ms). Trace:
W20260807 15:10:54.228000 29569 rpcz_store.cc:269] 0807 15:10:52.756393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:52.884150 (+127757us) service_pool.cc:227] Handling call
0807 15:10:54.206781 (+1322631us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b5800004598. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:10:54.224549 (+ 17768us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":149287808}
I20260807 15:10:54.229082 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:54.230695 30273 leader_election.cc:334] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.777s (SENT)
I20260807 15:10:54.230926 30272 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:54.232517 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.226861 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.233552 29565 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:54.140472 482 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260807 15:10:54.241449 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.242450 29567 raft_consensus.cc:2362] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4. Re-sending same reply.
I20260807 15:10:54.243096 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2184) took 1275 ms. Trace:
I20260807 15:10:54.218498 29566 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:10:54.245687 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.243665 29567 rpcz_store.cc:276] 0807 15:10:52.968162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.170743 (+1202581us) service_pool.cc:227] Handling call
0807 15:10:54.243042 (+ 72299us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.248590 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:10:54.248840 29450 leader_election.cc:334] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.753s (SENT)
I20260807 15:10:54.249054 29566 raft_consensus.cc:2396] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260807 15:10:54.249409 29563 raft_consensus.cc:2379] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 6: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:54.249293 29450 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:54.249691 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2190) took 1279 ms. Trace:
I20260807 15:10:54.249851 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2188) took 1280 ms. Trace:
I20260807 15:10:54.250139 29566 rpcz_store.cc:276] 0807 15:10:52.969989 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.245362 (+1275373us) service_pool.cc:227] Handling call
0807 15:10:54.249621 (+ 4259us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.250216 29563 rpcz_store.cc:276] 0807 15:10:52.969403 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.208643 (+1239240us) service_pool.cc:227] Handling call
0807 15:10:54.249793 (+ 41150us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.259577 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.259696 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.260674 29566 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:54.262346 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.260321 29570 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:54.263965 29561 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:54.267385 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 839) took 1172 ms. Trace:
I20260807 15:10:54.267714 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.269186 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.272013 29567 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:54.272521 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2187) took 1303 ms. Trace:
I20260807 15:10:54.239524 399 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:54.272869 29567 rpcz_store.cc:276] 0807 15:10:52.969107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.247295 (+1278188us) service_pool.cc:227] Handling call
0807 15:10:54.272451 (+ 25156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.269138 29561 rpcz_store.cc:276] 0807 15:10:53.094924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.132770 (+1037846us) service_pool.cc:227] Handling call
0807 15:10:54.267310 (+134540us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.262271 32733 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:54.275954 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2134) took 1525 ms. Trace:
W20260807 15:10:54.276160 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 179763us
I20260807 15:10:54.278273 29563 rpcz_store.cc:276] 0807 15:10:52.750269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.251358 (+1501089us) service_pool.cc:227] Handling call
0807 15:10:54.275852 (+ 24494us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.240248 370 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:54.292550 29563 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 4
I20260807 15:10:54.288825 29565 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:54.316228 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.316967 29564 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:54.274866 399 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:54.320533 29565 raft_consensus.cc:1261] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 15:10:54.305928 29566 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:10:54.336448 506 log.cc:924] Time spent T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.103s user 0.000s sys 0.001s
I20260807 15:10:54.325462 399 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:54.351099 510 log.cc:924] Time spent T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260807 15:10:54.352110 29564 raft_consensus.cc:3032] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:54.352548 29564 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:54.353621 29564 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.356448 486 raft_consensus.cc:3032] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:54.356905 486 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:54.357785 486 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.363034 29570 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260807 15:10:54.364198 29591 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7420 after lost signal to thread 29674
W20260807 15:10:54.365468 29591 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2d40 after lost signal to thread 30341
I20260807 15:10:54.367136 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.371650 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.372874 424 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.374466 29570 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:54.375379 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.336479 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.355261 29564 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 7
I20260807 15:10:54.381177 29570 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
W20260807 15:10:54.389178 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 58429us
I20260807 15:10:54.389688 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.390350 29570 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:54.387830 29560 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:54.390936 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 840) took 1110 ms. Trace:
W20260807 15:10:54.391784 29568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2177) took 1629 ms (client timeout 2081 ms). Trace:
I20260807 15:10:54.393376 29560 rpcz_store.cc:276] 0807 15:10:53.280634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.130235 (+849601us) service_pool.cc:227] Handling call
0807 15:10:54.390885 (+260650us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.375268 424 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:54.393509 29568 rpcz_store.cc:269] 0807 15:10:52.762226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.336102 (+1573876us) service_pool.cc:227] Handling call
0807 15:10:54.391729 (+ 55627us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:10:54.397522 29561 raft_consensus.cc:1261] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 15:10:54.397651 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.371258 344 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:54.401289 29570 raft_consensus.cc:2396] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260807 15:10:54.401836 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.411417 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.412693 29560 raft_consensus.cc:2396] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260807 15:10:54.413082 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.410161 424 consensus_queue.cc:1035] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260807 15:10:54.417686 492 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:54.418243 492 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:54.420256 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.420871 29568 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:10:54.426331 508 log.cc:924] Time spent T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.148s user 0.003s sys 0.000s
I20260807 15:10:54.427323 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:54.426100 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:54.429188 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.429386 492 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:54.367661 405 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.430409 29570 raft_consensus.cc:2396] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260807 15:10:54.429298 344 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:54.431367 405 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:54.414059 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.389008 370 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:54.432570 32700 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260807 15:10:54.455340 486 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:54.435739 29563 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:54.460803 29645 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260807 15:10:54.461516 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.461723 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.463073 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.463254 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.435981 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.442786 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:54.448346 29568 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:54.468122 29560 raft_consensus.cc:2396] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260807 15:10:54.469193 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:54.412045 501 log.cc:924] Time spent T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.076s user 0.001s sys 0.000s
I20260807 15:10:54.476725 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.477051 29564 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260807 15:10:54.478730 29564 pending_rounds.cc:76] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Aborting all ops after (but not including) 6
I20260807 15:10:54.479074 29563 raft_consensus.cc:2379] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:54.480250 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.481973 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:54.482934 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 76238us
I20260807 15:10:54.484647 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.478984 29564 pending_rounds.cc:97] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.7
I20260807 15:10:54.486855 29564 raft_consensus.cc:2894] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Aborting config change with OpId 5.7: Aborted: Op aborted by new leader
I20260807 15:10:54.487349 29564 raft_consensus.cc:2866] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:10:54.487743 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.488070 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52540 (request call id 849) took 5494 ms. Trace:
I20260807 15:10:54.489025 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.483541 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.489744 29561 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:54.490746 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.491328 29568 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:54.492050 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.493134 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.493865 29563 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:54.506554 430 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:54.488463 29564 rpcz_store.cc:276] 0807 15:10:48.993817 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:49.012436 (+ 18619us) service_pool.cc:227] Handling call
0807 15:10:49.102685 (+ 90249us) log.cc:842] Serialized 508 byte log entry
0807 15:10:50.362213 (+1259528us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54003bd420. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd5d416 00007f94dbd56daa 00007f94dbd56014 00007f94dbd3e545 00007f94dbd43771 00007f94dbd436f9 00007f94dbd43689 00007f94dbd43651 00007f94dbd4281d 00007f94e2100204
0807 15:10:50.451172 (+ 88959us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18004532e0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e69f96 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd55a4f 00007f94dbd3e545 00007f94dbd43771
0807 15:10:50.481876 (+ 30704us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b54003bd420. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd55a4f 00007f94dbd3e545 00007f94dbd43771 00007f94dbd436f9 00007f94dbd43689 00007f94dbd43651 00007f94dbd4281d 00007f94e2100204 00007f94e2100039 00007f94d8e9c6b6
0807 15:10:54.487991 (+4006115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11294,"raft.queue_time_us":14130,"raft.run_cpu_time_us":21500,"raft.run_wall_time_us":2169821,"spinlock_wait_cycles":123334912,"thread_start_us":226000,"threads_started":1,"wal-append.queue_time_us":466562,"wal-append.run_cpu_time_us":8934,"wal-append.run_wall_time_us":1316487}
I20260807 15:10:54.523769 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.524708 29563 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:10:54.537127 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.538056 29563 raft_consensus.cc:2362] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6. Re-sending same reply.
I20260807 15:10:54.533903 32626 raft_consensus.cc:3032] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:54.543704 32626 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:54.545385 424 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:10:54.551323 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:54.554008 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:54.565804 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:54.566704 29560 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:54.567071 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:54.572582 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.582253 29484 raft_consensus.cc:1226] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:54.585433 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.590708 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:54.593799 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.595142 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.599822 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:54.604703 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:54.605371 29479 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:54.610667 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.612933 29488 raft_consensus.cc:1226] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:54.508320 405 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260807 15:10:54.618191 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.627491 29568 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:54.630424 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:54.631342 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.631886 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.634018 29568 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 15:10:54.635306 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:54.635577 29568 raft_consensus.cc:3032] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:10:54.636080 29568 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:54.636181 30310 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:10:54.637179 29568 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.642814 29568 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:54.647055 29561 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:54.648984 30310 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 15:10:54.647861 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.648602 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:54.661106 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 159462us
I20260807 15:10:54.661618 30273 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:54.669345 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:54.663014 29560 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:54.689615 29560 raft_consensus.cc:1226] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
W20260807 15:10:54.697713 29533 connection.cc:232] RPC call timeout handler was delayed by -1.8457901040092111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260807 15:10:54.704361 29533 connection.cc:232] RPC call timeout handler was delayed by -1.8457901040092111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260807 15:10:54.704696 29533 connection.cc:232] RPC call timeout handler was delayed by -1.8196901040500961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260807 15:10:54.704972 29533 connection.cc:232] RPC call timeout handler was delayed by -1.8187901040073484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260807 15:10:54.705231 29533 connection.cc:232] RPC call timeout handler was delayed by -1.7710901040118188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260807 15:10:54.705483 29533 connection.cc:232] RPC call timeout handler was delayed by -1.7710901040118188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260807 15:10:54.705718 29533 connection.cc:232] RPC call timeout handler was delayed by -1.7179901040508412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260807 15:10:54.705950 29533 connection.cc:232] RPC call timeout handler was delayed by -1.7143901040544733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260807 15:10:54.706178 29533 connection.cc:232] RPC call timeout handler was delayed by -1.7125901040271856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260807 15:10:54.706413 29533 connection.cc:232] RPC call timeout handler was delayed by -1.6522901040152647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260807 15:10:54.706629 29533 connection.cc:232] RPC call timeout handler was delayed by -1.6360901040607132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260807 15:10:54.706853 29533 connection.cc:232] RPC call timeout handler was delayed by -1.625290104013402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260807 15:10:54.707099 29533 connection.cc:232] RPC call timeout handler was delayed by -1.5595901040360332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260807 15:10:54.707331 29533 connection.cc:232] RPC call timeout handler was delayed by -1.5298901040223427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260807 15:10:54.707566 29533 connection.cc:232] RPC call timeout handler was delayed by -1.5235901040141471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260807 15:10:54.695381 484 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:54.700515 370 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:54.708662 370 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.710815 370 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:54.712499 29450 leader_election.cc:334] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.270s (SENT)
I20260807 15:10:54.665198 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:54.707789 29533 connection.cc:232] RPC call timeout handler was delayed by -1.5037901040050201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260807 15:10:54.714711 29533 connection.cc:232] RPC call timeout handler was delayed by -1.4830901040113531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260807 15:10:54.715107 29533 connection.cc:232] RPC call timeout handler was delayed by -1.480390104057733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260807 15:10:54.715430 29533 connection.cc:232] RPC call timeout handler was delayed by -1.480390104057733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260807 15:10:54.715725 29533 connection.cc:232] RPC call timeout handler was delayed by -1.3813901040120982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260807 15:10:54.714577 29608 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:54.716066 29533 connection.cc:232] RPC call timeout handler was delayed by -1.2598901040037163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260807 15:10:54.716440 29533 connection.cc:232] RPC call timeout handler was delayed by -1.2427901040064171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260807 15:10:54.716799 29533 connection.cc:232] RPC call timeout handler was delayed by -1.2427901040064171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260807 15:10:54.717257 29533 connection.cc:232] RPC call timeout handler was delayed by -1.240090104052797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260807 15:10:54.717681 29533 connection.cc:232] RPC call timeout handler was delayed by -1.2346901040291414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
I20260807 15:10:54.721159 29560 raft_consensus.cc:3032] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:54.721711 29560 raft_consensus.cc:729] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:54.724844 29608 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:54.726599 29568 raft_consensus.cc:1261] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260807 15:10:54.728760 29568 pending_rounds.cc:76] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Aborting all ops after (but not including) 7
I20260807 15:10:54.729485 29568 pending_rounds.cc:97] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260807 15:10:54.730225 29568 raft_consensus.cc:2866] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:10:54.738849 29561 raft_consensus.cc:1226] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:10:54.724670 29560 consensus_queue.cc:260] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.746628 29561 raft_consensus.cc:1261] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:10:54.746815 29560 raft_consensus.cc:3037] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:54.747112 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:54.748085 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:54.613463 32626 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:54.758181 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 45715.2us
I20260807 15:10:54.758543 32708 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260807 15:10:54.759254 29450 leader_election.cc:334] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 3.315s (SENT)
I20260807 15:10:54.772231 29533 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:10:54.778048 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 116499us
W20260807 15:10:54.779351 30273 leader_election.cc:334] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.201s (SENT)
I20260807 15:10:54.780372 30273 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:54.782603 541 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:54.745251 336 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:54.744984 32703 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
W20260807 15:10:54.787318 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 171424us
I20260807 15:10:54.767424 32727 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:54.806118 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 46882us
I20260807 15:10:54.806592 29560 raft_consensus.cc:1261] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260807 15:10:54.807098 29560 pending_rounds.cc:76] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: Aborting all ops after (but not including) 6
I20260807 15:10:54.807380 29560 pending_rounds.cc:97] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260807 15:10:54.807669 29560 raft_consensus.cc:2866] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 15:10:54.800539 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 196980us
I20260807 15:10:54.788036 337 raft_consensus.cc:2741] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 15:10:54.750334 399 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.840481 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2856) took 1049 ms. Trace:
I20260807 15:10:54.841125 29569 rpcz_store.cc:276] 0807 15:10:53.791469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.270142 (+478673us) service_pool.cc:227] Handling call
0807 15:10:54.270493 (+ 351us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:54.270725 (+ 232us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 15:10:54.629794 (+359069us) log.cc:842] Serialized 14 byte log entry
0807 15:10:54.821638 (+191844us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:54.840044 (+ 18406us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:54.840125 (+ 81us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:54.840232 (+ 107us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:54.840402 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":361426,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"thread_start_us":530399,"threads_started":2,"wal-append.queue_time_us":188012}
I20260807 15:10:54.846891 29569 raft_consensus.cc:1261] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 15:10:54.852959 29533 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:54.802203 32703 raft_consensus.cc:686] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:54.808575 336 raft_consensus.cc:686] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:54.813278 328 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:54.880455 32705 consensus_queue.cc:1046] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260807 15:10:54.838616 32727 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:54.884608 328 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:54.881285 30304 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:54.897338 29566 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:10:54.937988 29566 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 15:10:54.909691 30312 raft_consensus.cc:1226] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:54.919238 29450 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:54.925060 30309 raft_consensus.cc:1226] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 6 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
W20260807 15:10:54.945230 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 48017.5us
I20260807 15:10:54.898243 32705 raft_consensus.cc:3032] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:10:54.917166 399 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:54.907727 518 log.cc:924] Time spent T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.291s user 0.002s sys 0.000s
I20260807 15:10:54.915942 328 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 1 FOLLOWER]: Advancing to term 2
W20260807 15:10:54.902407 522 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.116s user 0.000s sys 0.000s
I20260807 15:10:54.912175 337 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:54.953964 29450 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:55.043283 29570 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:10:55.069779 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 254522us
I20260807 15:10:55.004137 29479 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
W20260807 15:10:55.092907 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 139053us
I20260807 15:10:55.092926 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:54.912104 32727 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:54.949378 29569 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260807 15:10:55.071961 536 log.cc:924] Time spent T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.191s user 0.004s sys 0.000s
I20260807 15:10:54.900249 32694 consensus_queue.cc:1035] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.207s
W20260807 15:10:55.116705 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 303665us
I20260807 15:10:55.074235 32626 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:55.000945 430 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:54.996328 32705 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:55.107832 32733 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:54.926215 32703 consensus_queue.cc:237] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:55.170063 29570 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 15:10:55.017396 336 consensus_queue.cc:237] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:55.201512 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:55.219527 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:55.151692 32312 consensus_queue.cc:1035] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260807 15:10:55.299214 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2877) took 1204 ms. Trace:
I20260807 15:10:55.299865 29563 rpcz_store.cc:276] 0807 15:10:54.095038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.606915 (+511877us) service_pool.cc:227] Handling call
0807 15:10:54.607237 (+ 322us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:54.607575 (+ 338us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:54.607617 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:54.608077 (+ 460us) log.cc:842] Serialized 26 byte log entry
0807 15:10:54.763839 (+155762us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:54.806202 (+ 42363us) log.cc:842] Serialized 14 byte log entry
0807 15:10:54.815682 (+ 9480us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:54.815784 (+ 102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:54.911586 (+ 95802us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b1800277f00. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:10:55.007299 (+ 95713us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:10:55.298904 (+291605us) raft_consensus.cc:1671] finished
0807 15:10:55.298942 (+ 38us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:55.299132 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43009,"prepare.queue_time_us":51941,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":73863,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":9637,"spinlock_wait_cycles":14192640,"thread_start_us":125989,"threads_started":1,"wal-append.queue_time_us":184779}
I20260807 15:10:55.293964 30303 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260807 15:10:55.306007 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 211892us
I20260807 15:10:55.276989 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:55.180946 32705 consensus_queue.cc:260] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:55.346858 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 537153us
I20260807 15:10:55.403496 390 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260807 15:10:55.396852 430 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:55.411258 430 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:55.413887 430 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:55.415118 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:55.416564 29640 raft_consensus.cc:2379] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 6: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:55.429126 29533 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:55.431166 542 log.cc:924] Time spent T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.204s user 0.000s sys 0.001s
W20260807 15:10:55.460713 557 log.cc:924] Time spent T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.064s user 0.001s sys 0.000s
I20260807 15:10:55.465668 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 869) took 1085 ms. Trace:
W20260807 15:10:55.466725 551 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.084s user 0.000s sys 0.001s
W20260807 15:10:55.468350 540 log.cc:924] Time spent T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.287s user 0.001s sys 0.000s
I20260807 15:10:55.470358 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 875) took 1019 ms. Trace:
W20260807 15:10:55.476672 30304 consensus_meta.cc:287] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.558s user 0.013s sys 0.000s
I20260807 15:10:55.477309 30304 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
W20260807 15:10:55.478334 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 106701us
I20260807 15:10:55.480489 29533 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:55.484120 29481 raft_consensus.cc:2396] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260807 15:10:55.484747 539 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:10:55.432140 546 log.cc:924] Time spent T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.125s user 0.001s sys 0.000s
I20260807 15:10:55.489019 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2882) took 1003 ms. Trace:
I20260807 15:10:55.489399 29565 rpcz_store.cc:276] 0807 15:10:54.485287 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.746677 (+261390us) service_pool.cc:227] Handling call
0807 15:10:54.772740 (+ 26063us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:55.032103 (+259363us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:55.032138 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:55.042393 (+ 10255us) log.cc:842] Serialized 26 byte log entry
0807 15:10:55.327190 (+284797us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:55.383122 (+ 55932us) log.cc:842] Serialized 14 byte log entry
0807 15:10:55.383438 (+ 316us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:55.383513 (+ 75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:55.488801 (+105288us) raft_consensus.cc:1671] finished
0807 15:10:55.488821 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:55.488959 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8597,"prepare.queue_time_us":83415,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":33734,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":29600,"thread_start_us":432173,"threads_started":2,"wal-append.queue_time_us":359309}
I20260807 15:10:55.470808 29568 rpcz_store.cc:276] 0807 15:10:54.450554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.731633 (+281079us) service_pool.cc:227] Handling call
0807 15:10:54.732076 (+ 443us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:54.732343 (+ 267us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:54.732379 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:54.743994 (+ 11615us) log.cc:842] Serialized 26 byte log entry
0807 15:10:54.875188 (+131194us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:54.897768 (+ 22580us) log.cc:842] Serialized 14 byte log entry
0807 15:10:55.173318 (+275550us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18004009c0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94dba5382c 00007f94d8e7e9dc 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e99155 00007f94dbdbc3d0 00007f94dbdce576 00007f94dbddf0d7
0807 15:10:55.173480 (+ 162us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:55.173574 (+ 94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:55.470003 (+296429us) raft_consensus.cc:1671] finished
0807 15:10:55.470121 (+ 118us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:55.470285 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17267,"prepare.queue_time_us":22979,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":105260,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"spinlock_wait_cycles":2583296,"thread_start_us":328974,"threads_started":2,"wal-append.queue_time_us":335850}
I20260807 15:10:55.455870 32705 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:55.496101 404 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:55.496646 556 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:55.496753 404 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:55.498924 29533 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.502535 539 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:10:55.499128 404 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:55.497246 556 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:55.466127 29564 rpcz_store.cc:276] 0807 15:10:54.380407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.686940 (+306533us) service_pool.cc:227] Handling call
0807 15:10:54.700608 (+ 13668us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:54.713873 (+ 13265us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:54.713906 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:54.714310 (+ 404us) log.cc:842] Serialized 26 byte log entry
0807 15:10:54.821289 (+106979us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:10:54.886075 (+ 64786us) log.cc:842] Serialized 14 byte log entry
0807 15:10:55.139382 (+253307us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b18002d9280. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:10:55.144256 (+ 4874us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:55.144381 (+ 125us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:55.465375 (+320994us) raft_consensus.cc:1671] finished
0807 15:10:55.465472 (+ 97us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:55.465603 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35913,"prepare.queue_time_us":70995,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":128493,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":24485,"spinlock_wait_cycles":69309312,"thread_start_us":318786,"threads_started":2,"wal-append.queue_time_us":158428}
I20260807 15:10:55.513847 29533 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:55.527612 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 126441us
W20260807 15:10:55.537981 29567 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.648s user 0.018s sys 0.053s
I20260807 15:10:55.491236 328 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:55.538422 29567 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.652s user 0.018s sys 0.053s
I20260807 15:10:55.539090 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2875) took 1444 ms. Trace:
I20260807 15:10:55.539968 29533 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.542694 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:55.539494 29567 rpcz_store.cc:276] 0807 15:10:54.094473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.330220 (+235747us) service_pool.cc:227] Handling call
0807 15:10:54.401896 (+ 71676us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:54.402140 (+ 244us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 15:10:54.640171 (+238031us) log.cc:842] Serialized 14 byte log entry
0807 15:10:55.538753 (+898582us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:55.538808 (+ 55us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:55.538858 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:55.538923 (+ 65us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:55.539038 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29701,"prepare.queue_time_us":230643,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":121308,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":43158272,"thread_start_us":1082071,"threads_started":3,"wal-append.queue_time_us":314272}
I20260807 15:10:55.543550 30309 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:55.542922 29533 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.545444 555 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:55.555317 549 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:55.557654 543 log.cc:924] Time spent T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.459s user 0.003s sys 0.000s
I20260807 15:10:55.575069 328 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:55.576058 29566 raft_consensus.cc:1226] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 1. Current term is 2. Ops: []
I20260807 15:10:55.542876 539 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:55.578452 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2801) took 1027 ms. Trace:
I20260807 15:10:55.578857 29481 rpcz_store.cc:276] 0807 15:10:54.550896 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.551027 (+ 131us) service_pool.cc:227] Handling call
0807 15:10:55.578221 (+1027194us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54000f8cd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:55.578365 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2142388608}
I20260807 15:10:55.528652 556 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:55.584713 29452 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:55.600001 29533 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.605212 29533 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.604436 539 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:55.607398 545 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:55.603369 332 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:55.609077 29608 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.622571 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.624212 534 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:55.604578 555 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260807 15:10:55.613909 332 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:55.616616 30304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48588 (request call id 857) took 1232 ms. Trace:
I20260807 15:10:55.630973 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:55.616735 344 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260807 15:10:55.618278 411 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260807 15:10:55.609854 568 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260807 15:10:55.636132 332 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:55.634549 32727 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:10:55.656862 29533 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:55.636718 30304 rpcz_store.cc:276] 0807 15:10:54.382861 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:54.389137 (+ 6276us) service_pool.cc:227] Handling call
0807 15:10:55.611501 (+1222364us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540078dcd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:55.615562 (+ 4061us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1037136256}
I20260807 15:10:55.685344 400 consensus_queue.cc:1046] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:10:55.685603 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:55.673570 545 raft_consensus.cc:2741] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260807 15:10:55.724325 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 82249.8us
I20260807 15:10:55.725020 29533 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.739162 321 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:55.758656 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:52540 (request call id 851) took 1018 ms. Trace:
I20260807 15:10:55.759140 29560 rpcz_store.cc:276] 0807 15:10:54.740213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:55.474970 (+734757us) service_pool.cc:227] Handling call
0807 15:10:55.757759 (+282789us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400190d54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e0d09c6e 00007f94da400807 00007f94da400792 00007f94da4006c1 00007f94da40063c 00007f94da3ff8f2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:55.758559 (+ 800us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":542817152}
I20260807 15:10:55.735265 545 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:55.737192 547 raft_consensus.cc:3032] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:10:55.765102 547 raft_consensus.cc:729] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:55.766054 547 consensus_queue.cc:260] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:55.767707 547 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:55.788312 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.763347 556 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:55.739751 321 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:55.800412 321 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:55.802110 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 63224.3us
I20260807 15:10:55.803148 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:55.806396 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:55.793253 545 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:55.810148 545 raft_consensus.cc:2741] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 15:10:55.809468 29533 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.820484 545 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:55.822000 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.822305 556 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:55.824999 29567 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 15:10:55.822945 29566 raft_consensus.cc:1226] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:55.823414 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:55.827526 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.831923 556 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:55.834450 556 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:55.836005 29533 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.837422 29533 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.840749 29533 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:55.847518 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 180966us
I20260807 15:10:55.848805 545 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:55.849823 418 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260807 15:10:55.862592 424 consensus_queue.cc:1046] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:10:55.864864 32727 raft_consensus.cc:3032] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:55.865342 32727 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:55.866353 32727 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:55.868099 32727 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:55.874413 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:55.875243 30303 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:55.876195 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.843111 555 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:55.836190 332 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:55.879645 29484 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:55.880115 545 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:10:55.880798 332 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:55.881596 29533 leader_election.cc:398] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5.
I20260807 15:10:55.881932 29533 leader_election.cc:401] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:10:55.882649 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:55.883334 555 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5.
I20260807 15:10:55.886521 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.893024 29533 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:55.896389 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:55.929090 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:55.931788 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:55.936415 29382 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 366) took 13332 ms (client timeout 15000 ms). Trace:
I20260807 15:10:55.937389 539 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:55.935017 29533 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.897070 555 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:55.942787 29533 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:55.943282 29450 leader_election.cc:334] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.135s (SENT)
I20260807 15:10:55.944710 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:55.946041 29450 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:55.930348 404 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 15:10:55.936885 29382 rpcz_store.cc:269] 0807 15:10:42.603843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:42.614941 (+ 11098us) service_pool.cc:227] Handling call
0807 15:10:45.283345 (+2668404us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e1d1ed6c 00007f94e1e18c3e 00007f94e012afb4 00007f94e012af42 00007f94e012ae71 00007f94e012adec 00007f94e012a0a2 00007f94da1ee94c 00007f94da1edd86
0807 15:10:55.936351 (+10653006us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:54.626308 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:54.710162 (+ 83854us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:54.710228 (+ 66us) write_op.cc:435] Acquired schema lock
0807 15:10:54.710241 (+ 13us) tablet.cc:660] Decoding operations
0807 15:10:54.710956 (+ 715us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:54.711045 (+ 89us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:54.711077 (+ 32us) tablet.cc:683] Acquiring locks for 3 operations
0807 15:10:54.711500 (+ 423us) tablet.cc:699] Row locks acquired
0807 15:10:54.711531 (+ 31us) write_op.cc:260] PREPARE: finished
0807 15:10:54.711693 (+ 162us) write_op.cc:270] Start()
0807 15:10:54.711851 (+ 158us) write_op.cc:276] Timestamp: P: 1786115454711628 usec, L: 0
0807 15:10:54.711873 (+ 22us) op_driver.cc:331] REPLICATION: starting
0807 15:10:54.794399 (+ 82526us) log.cc:842] Serialized 1316 byte log entry
0807 15:10:55.688987 (+894588us) op_driver.cc:444] REPLICATION: finished
0807 15:10:55.850647 (+161660us) write_op.cc:301] APPLY: starting
0807 15:10:55.857002 (+ 6355us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:55.857157 (+ 155us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:55.857290 (+ 133us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:55.857850 (+ 560us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:55.858100 (+ 250us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0807 15:10:55.858162 (+ 62us) write_op.cc:312] APPLY: finished
0807 15:10:55.858419 (+ 257us) log.cc:842] Serialized 35 byte log entry
0807 15:10:55.859327 (+ 908us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:55.859458 (+ 131us) write_op.cc:454] Released schema lock
0807 15:10:55.859504 (+ 46us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:55.859871 (+ 367us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:55.859923 (+ 52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1946953,"reported_tablets":16,"spinlock_wait_cycles":718140160,"child_traces":[["op",{"apply.queue_time_us":154221,"apply.run_cpu_time_us":2664,"apply.run_wall_time_us":13249,"num_ops":3,"prepare.queue_time_us":414556,"prepare.run_cpu_time_us":15345,"prepare.run_wall_time_us":533934,"raft.queue_time_us":197454,"raft.run_cpu_time_us":13531,"raft.run_wall_time_us":246174,"replication_time_us":965111,"thread_start_us":955778,"threads_started":4,"wal-append.queue_time_us":526719}]]}
I20260807 15:10:55.956378 29533 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.932344 545 raft_consensus.cc:2741] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260807 15:10:55.965770 29533 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.940431 328 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:55.939735 29379 catalog_manager.cc:5495] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:55.960443 404 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:55.941833 539 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:55.944285 32705 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:55.959110 32671 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:55.958822 556 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:10:55.954511 568 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:55.985669 29379 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 5 to 6, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 6 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:55.964774 549 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:55.980460 555 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:55.979223 404 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:10:56.018267 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 52589us
I20260807 15:10:56.018944 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:56.019816 29533 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:56.020296 29379 catalog_manager.cc:5495] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:10:56.021802 549 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:56.025064 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:56.026678 29533 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:55.990310 32705 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.034456 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:56.034720 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:56.035497 29568 raft_consensus.cc:2354] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7.
I20260807 15:10:56.034895 568 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:56.037295 32705 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:56.037755 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:56.039547 29568 raft_consensus.cc:1226] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6. Ops: []
I20260807 15:10:56.040632 29563 raft_consensus.cc:1226] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:56.040892 29566 raft_consensus.cc:1261] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:56.020941 555 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:56.048784 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:56.053851 29564 raft_consensus.cc:1261] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 15:10:56.043984 29568 raft_consensus.cc:1203] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3] Dedup: 3.3->[]
I20260807 15:10:56.045543 30273 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:56.056546 29568 raft_consensus.cc:1226] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 15:10:56.062629 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:56.053962 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:56.073719 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:56.032310 556 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:56.078836 29450 leader_election.cc:398] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7.
I20260807 15:10:56.082612 29450 leader_election.cc:401] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:10:56.084857 29450 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:56.082557 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:56.086412 29568 raft_consensus.cc:2362] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5. Re-sending same reply.
W20260807 15:10:56.085016 29366 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 1177fe2445db43e2b8366f33a841a041 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260807 15:10:56.089761 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:56.089948 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:56.090883 29568 raft_consensus.cc:2362] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3. Re-sending same reply.
I20260807 15:10:56.092463 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:56.060990 533 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:56.093778 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:56.094280 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:56.060735 321 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:56.080363 332 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:56.090380 29643 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:56.105923 29449 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:56.088577 562 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7.
I20260807 15:10:56.088181 32694 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:56.079028 537 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260807 15:10:56.122231 29561 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 15:10:56.120456 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:56.081408 471 consensus_queue.cc:1046] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260807 15:10:56.081347 399 consensus_queue.cc:1035] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260807 15:10:56.099368 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:56.128232 29533 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:56.064494 404 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.132562 29533 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:56.110440 494 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 15:10:56.136121 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 55801.9us
I20260807 15:10:56.139202 569 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:10:56.137679 494 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:56.141052 494 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:56.097561 32733 consensus_queue.cc:1035] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260807 15:10:56.131134 555 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:56.105075 321 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.105309 30304 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:10:56.124010 537 consensus_queue.cc:1225] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer 00dd11bf8fd9487580aba733c2996a4a log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260807 15:10:56.159978 30305 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:56.155301 589 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 15:10:56.233958 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 101441us
W20260807 15:10:56.288072 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 102638us
I20260807 15:10:56.278957 568 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:56.289011 568 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.291446 568 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:56.291916 32694 consensus_queue.cc:1035] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 15:10:56.288203 29481 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 15:10:56.109261 533 consensus_queue.cc:1046] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260807 15:10:56.308145 29640 raft_consensus.cc:2354] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7.
I20260807 15:10:56.310501 29533 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:56.315531 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 135090us
I20260807 15:10:56.150859 321 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:56.357525 494 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.328676 589 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:10:56.329910 555 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:56.445605 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 83759.1us
I20260807 15:10:56.445757 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:56.446107 29452 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:10:56.453538 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 374220us
W20260807 15:10:56.446384 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 84322us
I20260807 15:10:56.454766 29481 raft_consensus.cc:2354] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 6. Current term is 7.
W20260807 15:10:56.490819 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 50356.9us
I20260807 15:10:56.456218 32733 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election won for term 6
W20260807 15:10:56.569136 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50073.8us
I20260807 15:10:56.462370 32684 consensus_queue.cc:1035] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260807 15:10:56.462800 534 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
W20260807 15:10:56.586982 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 98196.5us
I20260807 15:10:56.459311 555 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.468441 399 consensus_queue.cc:1035] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260807 15:10:56.575567 600 log.cc:924] Time spent T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.088s user 0.001s sys 0.000s
W20260807 15:10:56.594357 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 126893us
I20260807 15:10:56.601136 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:56.603178 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:56.565836 32733 raft_consensus.cc:686] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:56.522661 404 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:56.575109 494 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:56.616460 29643 raft_consensus.cc:2379] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 6: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:10:56.522538 541 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260807 15:10:56.624171 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:56.643754 32733 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.645153 548 raft_consensus.cc:3032] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:56.645635 548 raft_consensus.cc:729] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:56.646520 548 consensus_queue.cc:260] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.512671 596 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
W20260807 15:10:56.640620 551 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.123s user 0.000s sys 0.001s
I20260807 15:10:56.663429 548 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:56.670660 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 96675.1us
W20260807 15:10:56.675460 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 218180us
I20260807 15:10:56.681779 555 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:56.682665 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:56.685246 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:56.667809 399 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:56.683372 30305 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 7
W20260807 15:10:56.699072 594 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.245s user 0.000s sys 0.001s
I20260807 15:10:56.698032 399 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.704795 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:56.713124 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 224536us
I20260807 15:10:56.848675 30273 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:56.849637 612 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:10:56.850998 30273 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:56.857894 30273 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:56.859054 612 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:56.865473 30274 leader_election.cc:398] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 6. Current term is 7.
I20260807 15:10:56.865818 30274 leader_election.cc:401] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260807 15:10:56.866473 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 161718us
I20260807 15:10:56.867579 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:56.871718 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 161978us
I20260807 15:10:56.880447 620 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:56.892068 321 raft_consensus.cc:3032] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:10:56.892628 321 raft_consensus.cc:729] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:56.892894 399 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:56.893604 321 consensus_queue.cc:260] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.894797 321 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
W20260807 15:10:56.900275 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 532212us
I20260807 15:10:56.899587 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:56.877490 618 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:56.905360 618 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:56.911095 29449 leader_election.cc:398] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7.
I20260807 15:10:56.919503 549 raft_consensus.cc:465] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Not starting pre-election -- already a leader
W20260807 15:10:56.921025 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 53596.9us
I20260807 15:10:56.925168 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:56.925987 29481 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
W20260807 15:10:56.958462 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 49466.6us
W20260807 15:10:56.958060 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 44981.1us
I20260807 15:10:56.906581 30305 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:56.956283 29567 pending_rounds.cc:76] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Aborting all ops after (but not including) 7
I20260807 15:10:56.970388 29567 pending_rounds.cc:97] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260807 15:10:56.970747 29567 raft_consensus.cc:2866] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:10:56.975960 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:10:56.976310 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 48195.9us
I20260807 15:10:56.976684 29643 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:56.978613 30312 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 15:10:56.991007 29452 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:56.993561 30274 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:57.020197 29643 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:56.971947 602 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 6. Current term is 7.
I20260807 15:10:56.997282 622 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:10:57.029277 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:57.008894 32684 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:57.008476 549 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:10:57.045639 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 51109.7us
I20260807 15:10:57.060339 618 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:57.037426 32684 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:57.061394 32684 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:57.110275 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:57.110941 29643 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:57.112965 30272 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:10:57.105620 625 log.cc:924] Time spent T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
W20260807 15:10:57.136906 623 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260807 15:10:57.119715 622 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:57.145607 622 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.118132 32727 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:57.125576 628 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:10:57.159029 32727 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:57.300607 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 78576.4us
I20260807 15:10:57.215591 32727 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:57.187757 628 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:57.331025 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 228238us
I20260807 15:10:57.365438 636 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:57.370296 471 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:57.371644 29643 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:57.366534 636 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.409137 637 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:57.325870 627 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:57.432035 29366 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 00dd11bf8fd9487580aba733c2996a4a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:57.381304 628 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:10:57.406615 328 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:57.403160 520 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:57.447690 30304 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:10:57.429636 568 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:57.423446 640 consensus_queue.cc:1046] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
W20260807 15:10:57.489413 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 479439us
I20260807 15:10:57.371707 471 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:57.494136 631 log.cc:924] Time spent T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.346s user 0.000s sys 0.002s
I20260807 15:10:57.518980 32694 raft_consensus.cc:3032] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:10:57.519686 32694 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:10:57.410167 637 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.436080 627 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.470188 520 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:57.620023 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 64592.5us
I20260807 15:10:57.485532 568 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.638623 627 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:57.641494 603 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.992s user 0.007s sys 0.027s
I20260807 15:10:57.642800 636 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:57.618363 32705 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.533s user 0.023s sys 0.055s
I20260807 15:10:57.646929 638 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:57.649452 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:57.650830 618 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:57.550966 641 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:10:57.679776 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 204868us
I20260807 15:10:57.683112 30309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 671) took 1601 ms. Trace:
I20260807 15:10:57.684042 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2207) took 1330 ms. Trace:
W20260807 15:10:57.681483 623 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260807 15:10:57.632296 549 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:10:57.700363 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 81172.2us
I20260807 15:10:57.759388 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:57.787627 29561 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:10:57.710592 29566 rpcz_store.cc:276] 0807 15:10:56.353962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:56.355340 (+ 1378us) service_pool.cc:227] Handling call
0807 15:10:56.355638 (+ 298us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:56.359227 (+ 3589us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:56.359267 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:56.359807 (+ 540us) log.cc:842] Serialized 26 byte log entry
0807 15:10:56.512738 (+152931us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:56.593742 (+ 81004us) log.cc:842] Serialized 14 byte log entry
0807 15:10:56.593980 (+ 238us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:56.594055 (+ 75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:57.638421 (+1044366us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b18001dc1a0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:10:57.655933 (+ 17512us) raft_consensus.cc:1671] finished
0807 15:10:57.683794 (+ 27861us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:57.683970 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43827,"prepare.queue_time_us":80646,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":5970,"raft.run_cpu_time_us":509,"raft.run_wall_time_us":99977,"spinlock_wait_cycles":6942976,"thread_start_us":152493,"threads_started":1,"wal-append.queue_time_us":284931}
I20260807 15:10:57.719722 635 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:57.726840 637 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:57.727602 641 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:57.730926 471 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:57.733448 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:57.734732 520 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:57.696393 32705 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.647s user 0.024s sys 0.055s
I20260807 15:10:57.709908 30309 rpcz_store.cc:276] 0807 15:10:56.081928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:56.082103 (+ 175us) service_pool.cc:227] Handling call
0807 15:10:56.088411 (+ 6308us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:56.104376 (+ 15965us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:56.104406 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:56.104754 (+ 348us) log.cc:842] Serialized 26 byte log entry
0807 15:10:56.244582 (+139828us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:10:56.461723 (+217141us) log.cc:842] Serialized 14 byte log entry
0807 15:10:56.517030 (+ 55307us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:57.658313 (+1141283us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b540046dcd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:57.658358 (+ 45us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:57.658408 (+ 50us) raft_consensus.cc:1671] finished
0807 15:10:57.682804 (+ 24396us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:57.683030 (+ 226us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":126421,"prepare.queue_time_us":338846,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":13183,"raft.queue_time_us":144764,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":24849,"spinlock_wait_cycles":30512000,"thread_start_us":243520,"threads_started":2,"wal-append.queue_time_us":219986,"wal-append.run_cpu_time_us":4313,"wal-append.run_wall_time_us":1308929}
I20260807 15:10:57.737805 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2932) took 1591 ms. Trace:
I20260807 15:10:57.740258 618 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:57.748572 646 log.cc:924] Time spent T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.089s user 0.001s sys 0.000s
I20260807 15:10:57.859972 29560 rpcz_store.cc:276] 0807 15:10:56.146670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:56.151202 (+ 4532us) service_pool.cc:227] Handling call
0807 15:10:56.151511 (+ 309us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 15:10:56.281570 (+130059us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:56.281606 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 15:10:56.282278 (+ 672us) log.cc:842] Serialized 52 byte log entry
0807 15:10:56.364390 (+ 82112us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:10:56.364428 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:56.364490 (+ 62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:57.431210 (+1066720us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:10:57.737473 (+306263us) raft_consensus.cc:1671] finished
0807 15:10:57.737495 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:57.737744 (+ 249us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9153,"raft.queue_time_us":57039,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":2813,"spinlock_wait_cycles":7306496,"thread_start_us":55399,"threads_started":1,"wal-append.queue_time_us":226971}
I20260807 15:10:57.699564 627 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:57.828106 631 log.cc:924] Time spent T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.131s user 0.000s sys 0.000s
I20260807 15:10:57.701277 424 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:57.889580 641 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:57.831023 549 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:57.696534 32684 consensus_meta.cc:287] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.635s user 0.014s sys 0.003s
I20260807 15:10:57.620846 32694 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.716105 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:57.866737 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:57.848554 537 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:57.846369 636 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:57.870913 30311 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 15:10:57.860837 32700 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:57.880088 400 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:57.875514 411 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:57.937125 411 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.888964 424 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.940739 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:57.941448 30310 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:10:57.710336 638 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.943080 424 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:57.904819 29450 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.605s user 0.026s sys 0.041s
W20260807 15:10:57.971431 29450 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.672s user 0.031s sys 0.046s
I20260807 15:10:57.924801 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:57.933917 32700 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.973201 618 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:57.922705 32684 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.976477 32700 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:57.949975 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:57.950105 537 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.950313 636 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:57.899026 627 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:57.966056 411 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:57.948977 32705 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260807 15:10:57.994654 29449 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.003113 29643 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260807 15:10:58.007445 29453 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.515s user 0.000s sys 0.021s
W20260807 15:10:58.008131 29453 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.516s user 0.000s sys 0.022s
I20260807 15:10:57.969832 568 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:57.950524 648 consensus_queue.cc:1159] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fbf78964d70448269802ac7de9d7a198" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 15:10:57.851876 635 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.935436 400 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.012306 400 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:57.938474 628 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.014007 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.015491 628 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:57.993525 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:57.925050 641 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:58.017735 641 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:57.996690 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:57.998646 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:57.999672 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:57.968871 638 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.022604 641 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.024077 635 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.031107 30307 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:58.033228 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.034236 29568 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:10:58.044359 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:57.976517 32684 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:57.987649 30309 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c"
dest_uuid: "fbf78964d70448269802ac7de9d7a198"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:41198
I20260807 15:10:58.065723 30309 raft_consensus.cc:595] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:58.057881 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.066010 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.066447 29642 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
W20260807 15:10:58.060186 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 63613.1us
I20260807 15:10:58.063176 29645 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
W20260807 15:10:58.057821 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 63265.7us
I20260807 15:10:57.990464 30304 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:58.069983 29567 raft_consensus.cc:2379] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:58.072539 30272 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:57.990440 494 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.073637 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.076022 29560 raft_consensus.cc:2379] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 2: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:58.079036 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.038914 29486 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
W20260807 15:10:58.080561 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 122197us
I20260807 15:10:58.082175 30274 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:58.030335 411 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:58.078341 30272 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:58.033771 568 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.112412 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.059849 609 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:10:58.126978 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 57904.1us
I20260807 15:10:58.129667 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.128425 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.104745 471 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:10:58.130986 29645 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:10:58.133056 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.136474 29568 raft_consensus.cc:2379] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:58.136775 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.136808 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.138329 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.139456 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.140987 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:58.141201 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:10:58.141376 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 59347us
I20260807 15:10:58.142004 29568 raft_consensus.cc:2379] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:10:58.145881 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 77316.8us
I20260807 15:10:58.147403 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.126471 641 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:58.163767 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.164100 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.165027 29482 raft_consensus.cc:2396] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260807 15:10:58.164101 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.165547 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.165985 29483 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:58.169518 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.096805 494 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.172235 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.174779 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.173965 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.162092 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.180589 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.135701 471 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:10:58.138170 609 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:58.123974 568 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.121264 411 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.180548 618 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:10:58.173555 32705 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.203428 32705 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:10:58.186564 659 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:58.208819 328 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.210057 328 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.214704 549 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.216497 636 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.217684 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.220359 328 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.171658 637 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:58.222929 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.227103 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.228300 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:58.241144 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 94209.4us
W20260807 15:10:58.233912 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 86911.5us
I20260807 15:10:58.157187 520 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260807 15:10:58.248282 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.229497 29533 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.229787 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.207211 32705 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:58.194249 471 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:10:58.233845 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 73150.9us
I20260807 15:10:58.220912 609 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.232647 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.249989 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.175730 641 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.270606 29533 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.278900 411 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.280467 609 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.281200 494 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.311578 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.284843 537 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:58.251026 637 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.232666 618 raft_consensus.cc:686] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:58.241315 659 raft_consensus.cc:686] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:58.295485 556 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 15:10:58.297621 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 54376.2us
I20260807 15:10:58.275419 568 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:58.311935 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 52753.7us
W20260807 15:10:58.312995 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 174706us
I20260807 15:10:58.259078 328 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:58.322829 29570 raft_consensus.cc:2379] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 2: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:10:58.323405 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 131873us
I20260807 15:10:58.326259 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.328001 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.326298 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.270570 627 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.331296 29609 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:58.331380 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.332921 29450 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:58.336732 29486 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:58.322228 30273 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:58.316838 556 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:58.347981 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:58.339779 30274 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:58.244371 616 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
W20260807 15:10:58.334735 634 log.cc:924] Time spent T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.938s user 0.008s sys 0.005s
W20260807 15:10:58.358017 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 188465us
I20260807 15:10:58.358563 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:58.370075 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:10:58.371104 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 202873us
I20260807 15:10:58.359239 29531 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.344483 666 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:58.376106 29449 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:58.350379 556 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:58.386457 29531 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.393278 637 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.393891 659 consensus_queue.cc:237] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.363245 305 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:10:58.407678 29609 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:58.413772 667 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.058s user 0.000s sys 0.001s
I20260807 15:10:58.414028 641 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:58.454913 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 115221us
I20260807 15:10:58.414625 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 895) took 1404 ms. Trace:
I20260807 15:10:58.414541 618 consensus_queue.cc:237] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.352288 662 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:10:58.515302 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 103459us
I20260807 15:10:58.420300 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.517051 29483 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
W20260807 15:10:58.433704 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 47339.3us
I20260807 15:10:58.427695 609 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:58.456889 29565 rpcz_store.cc:276] 0807 15:10:57.010258 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:57.010786 (+ 528us) service_pool.cc:227] Handling call
0807 15:10:57.025262 (+ 14476us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:57.036777 (+ 11515us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:57.036814 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:57.037182 (+ 368us) log.cc:842] Serialized 26 byte log entry
0807 15:10:57.117031 (+ 79849us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:10:57.448552 (+331521us) log.cc:842] Serialized 14 byte log entry
0807 15:10:57.448937 (+ 385us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:57.449053 (+ 116us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:58.291797 (+842744us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:10:58.414293 (+122496us) raft_consensus.cc:1671] finished
0807 15:10:58.414404 (+ 111us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:58.414555 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14754,"prepare.queue_time_us":7128,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":38636,"raft.run_cpu_time_us":515,"raft.run_wall_time_us":37309,"spinlock_wait_cycles":13239680,"thread_start_us":383342,"threads_started":2,"wal-append.queue_time_us":289431}
I20260807 15:10:58.384903 627 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:58.517987 29531 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:58.522004 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:10:58.518422 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 110870us
I20260807 15:10:58.439736 613 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:58.436703 328 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:58.442579 305 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:58.464785 653 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:58.519593 589 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:58.442269 637 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.530809 29609 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.452730 568 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.537948 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.417724 666 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.552688 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.546988 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:58.525247 534 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:58.525550 30305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 877) took 1526 ms. Trace:
I20260807 15:10:58.527307 613 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:58.529587 644 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:58.533357 636 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:58.528348 638 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.534960 305 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:58.566533 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:58.567224 683 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:58.522588 30304 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:10:58.529546 555 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.533349 662 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:58.581118 29608 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.537526 328 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:58.649425 643 log.cc:924] Time spent T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 1.238s user 0.004s sys 0.006s
I20260807 15:10:58.650293 674 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.651350 595 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 15:10:58.738857 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 157893us
I20260807 15:10:58.653071 675 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.656030 30307 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
W20260807 15:10:58.659147 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 93545.6us
I20260807 15:10:58.537985 653 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:58.540483 627 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.646730 471 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:58.724411 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 153551us
I20260807 15:10:58.762984 29452 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:10:58.655761 613 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:58.740005 29608 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.718031 321 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.651384 666 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:58.551573 637 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.558570 568 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.563256 30305 rpcz_store.cc:276] 0807 15:10:56.995430 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:57.934094 (+938664us) service_pool.cc:227] Handling call
0807 15:10:57.934633 (+ 539us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:57.934983 (+ 350us) raft_consensus.cc:1520] Early marking committed up to index 8
0807 15:10:58.108046 (+173063us) log.cc:842] Serialized 14 byte log entry
0807 15:10:58.441498 (+333452us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:58.451823 (+ 10325us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:10:58.508422 (+ 56599us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:58.519201 (+ 10779us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:58.521393 (+ 2192us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14549,"prepare.queue_time_us":239191,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3150,"raft.queue_time_us":19602,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":436843,"threads_started":3,"wal-append.queue_time_us":207774}
I20260807 15:10:58.746699 670 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:58.756711 653 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:58.724315 32705 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:58.792403 32705 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.735024 549 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 15:10:58.769870 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 227985us
I20260807 15:10:58.754428 662 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.740991 534 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:58.783034 32626 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:58.786034 390 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:58.788335 556 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.719564 638 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.796103 29452 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.666371 644 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.798494 549 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:58.732995 555 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.723544 683 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.825901 32671 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:58.827113 32705 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.829789 471 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.831954 328 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.810562 32626 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:10:58.742506 674 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:58.839172 681 log.cc:924] Time spent T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.158s user 0.001s sys 0.001s
I20260807 15:10:58.760227 675 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.900509 556 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.792236 568 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.847738 29561 raft_consensus.cc:2379] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:58.839018 662 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.765867 627 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.910137 627 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.773876 321 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.912293 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.913017 29483 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:10:58.914022 321 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.917372 638 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.938223 644 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.941959 683 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:58.943854 30274 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:58.946424 537 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:58.947090 537 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:58.822496 390 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:58.948377 390 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.949855 321 raft_consensus.cc:979] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198: : Instructing follower 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:58.947710 537 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:58.954125 555 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.962996 661 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.963986 661 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.961349 520 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:58.967041 674 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.968454 661 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:58.969211 537 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:58.897634 32626 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:58.965991 520 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:58.935236 637 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:10:58.884979 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 318567us
I20260807 15:10:58.891361 29531 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:58.818334 549 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:58.994313 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:58.998322 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.000176 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.001116 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.002461 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.003677 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:59.006529 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.007408 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.014900 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.016834 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.020417 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.022810 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.024618 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.025486 29643 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:10:59.028402 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.038497 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:59.039350 29479 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 4
I20260807 15:10:58.992159 678 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.050777 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.004006 661 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.015920 675 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.013046 390 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.127393 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.130546 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:10:59.132254 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:59.132194 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 82695.4us
I20260807 15:10:59.136205 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.145684 29479 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:10:59.152320 305 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.158243 520 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.160710 30303 raft_consensus.cc:1226] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7. Ops: []
I20260807 15:10:59.166458 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.161535 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.170604 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.173171 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.176414 32626 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.162029 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.162437 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:59.178195 549 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.190322 305 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.193250 29452 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.088919 678 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.199270 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.225749 32626 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.194152 30274 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:59.225445 678 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.211642 549 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:10:59.217319 692 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.092s user 0.000s sys 0.000s
I20260807 15:10:59.122547 661 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:59.250984 613 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.271032 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 901) took 1195 ms. Trace:
W20260807 15:10:59.271517 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 77471.7us
I20260807 15:10:59.272296 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 905) took 1132 ms. Trace:
I20260807 15:10:59.272033 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.271507 29563 rpcz_store.cc:276] 0807 15:10:58.075381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:58.076669 (+ 1288us) service_pool.cc:227] Handling call
0807 15:10:58.076973 (+ 304us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:10:58.116103 (+ 39130us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:58.116139 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:10:58.125806 (+ 9667us) log.cc:842] Serialized 26 byte log entry
0807 15:10:58.190985 (+ 65179us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:58.465993 (+275008us) log.cc:842] Serialized 14 byte log entry
0807 15:10:58.517131 (+ 51138us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:59.270056 (+752925us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b1800373ba0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e69f96 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9
0807 15:10:59.270682 (+ 626us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b54002206d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:59.270736 (+ 54us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:10:59.270794 (+ 58us) raft_consensus.cc:1671] finished
0807 15:10:59.270810 (+ 16us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:59.270964 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":65652,"prepare.queue_time_us":322421,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":62134,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":10039,"spinlock_wait_cycles":53982336,"thread_start_us":265990,"threads_started":2,"wal-append.queue_time_us":122015}
I20260807 15:10:59.275502 665 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:59.277496 665 raft_consensus.cc:686] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:59.280154 665 consensus_queue.cc:237] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:59.282994 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 391708us
I20260807 15:10:59.285802 29531 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.286243 399 raft_consensus.cc:1067] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Signalling peer 9bbe5c211ab64989a57350f34f007ced to start an election
I20260807 15:10:59.223510 29483 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:59.275789 30310 raft_consensus.cc:2379] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 4: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:59.223464 30312 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:59.207597 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.289278 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.290635 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.240713 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2973) took 1074 ms. Trace:
W20260807 15:10:59.240859 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 47690.5us
I20260807 15:10:59.249238 662 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:59.293197 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:59.251502 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.292249 29568 rpcz_store.cc:276] 0807 15:10:58.165809 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:58.167976 (+ 2167us) service_pool.cc:227] Handling call
0807 15:10:58.168236 (+ 260us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:58.252892 (+ 84656us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:58.252942 (+ 50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:58.253027 (+ 85us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:10:58.253076 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:59.240384 (+987308us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54002c5bd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:59.240451 (+ 67us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:59.240615 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":194117888}
I20260807 15:10:59.286103 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.295881 589 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:59.297119 589 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.272665 29570 rpcz_store.cc:276] 0807 15:10:58.140563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:58.140711 (+ 148us) service_pool.cc:227] Handling call
0807 15:10:59.272097 (+1131386us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540031a6d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:10:59.272241 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":406704000}
I20260807 15:10:59.300239 328 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.301231 683 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.301028 328 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:59.251643 32694 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:59.168358 537 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:59.298712 549 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:59.283725 30309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41198 (request call id 0) took 1326 ms. Trace:
I20260807 15:10:59.314641 30309 rpcz_store.cc:276] 0807 15:10:57.957400 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:57.957572 (+ 172us) service_pool.cc:227] Handling call
0807 15:10:58.411003 (+453431us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b5400535820. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd59dc0 00007f94dbdbe9c2 00007f94e0d0881a 00007f94da3fbd04 00007f94da3fbc92 00007f94da3fbbc1 00007f94da3fbb3c 00007f94da3fadf2 00007f94da1ee94c 00007f94da1edd86
0807 15:10:59.283331 (+872328us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5400535820. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbd57e67 00007f94dbdbefd8 00007f94dbdbebba 00007f94e0d0881a 00007f94da3fbd04 00007f94da3fbc92 00007f94da3fbbc1 00007f94da3fbb3c 00007f94da3fadf2 00007f94da1ee94c
0807 15:10:59.283586 (+ 255us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":40343552}
I20260807 15:10:59.306529 29531 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.306645 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.300946 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:59.319516 29483 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:10:59.320564 29531 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.316533 29563 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:10:59.313951 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.328461 29531 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:10:59.340029 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 279332us
I20260807 15:10:59.274792 661 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.299193 636 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:59.341202 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260807 15:10:59.302239 683 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:10:59.376699 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 241111us
I20260807 15:10:59.337543 638 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:59.313796 627 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.352850 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.384142 29565 raft_consensus.cc:2379] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:59.314065 555 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:10:59.393049 29609 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.196:43545 timed out after 2.212s (SENT) [suppressed 30 similar messages]
I20260807 15:10:59.393640 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.342525 568 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:59.396086 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 55175.8us
I20260807 15:10:59.339609 637 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:59.375797 328 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.405144 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:59.343346 674 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:10:59.338958 549 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.405836 30307 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 6
I20260807 15:10:59.408334 29646 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:10:59.409965 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2966) took 1654 ms. Trace:
I20260807 15:10:59.410540 29569 rpcz_store.cc:276] 0807 15:10:57.755981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:57.848740 (+ 92759us) service_pool.cc:227] Handling call
0807 15:10:57.849121 (+ 381us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:57.948377 (+ 99256us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:57.948421 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:57.948474 (+ 53us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:10:57.948526 (+ 52us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:59.409625 (+1461099us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b5400190d54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:59.409700 (+ 75us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:59.409885 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":227680512}
I20260807 15:10:59.413941 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.322093 589 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:59.421231 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.421929 29531 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.425024 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:59.425879 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.427443 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.427991 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.427541 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.430749 29569 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:10:59.436570 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.387353 627 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:59.407114 674 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:59.444917 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.446753 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:59.447749 29565 raft_consensus.cc:2354] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:59.420028 399 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260807 15:10:59.401134 555 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.404778 568 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.458295 568 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.458434 555 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.454627 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.433599 691 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:59.431609 613 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:10:59.478380 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 44381.3us
I20260807 15:10:59.481003 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.483079 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:59.483552 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:59.483775 29486 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:59.488214 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.488214 29533 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.489604 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.490137 29533 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.494549 627 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.440670 678 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.496475 678 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.500227 29481 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:55224
I20260807 15:10:59.501124 29481 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:10:59.501667 29481 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:10:59.502144 29366 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 00dd11bf8fd9487580aba733c2996a4a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:59.504487 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:59.504669 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.467947 674 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:10:59.515802 29533 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.519964 29533 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.525286 29450 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.527500 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.528860 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.531363 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:59.531494 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.509860 30273 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:59.522475 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.534484 29569 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:59.536207 328 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:59.539110 332 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:59.521840 691 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:59.532598 555 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:59.541429 549 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.476246 589 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.549398 29450 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.559051 29533 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.495651 627 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:10:59.561954 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 52185.5us
I20260807 15:10:59.562556 29486 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:10:59.562760 30273 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:59.505256 568 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:59.563448 29479 raft_consensus.cc:1226] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:10:59.565640 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.569949 29450 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:59.570953 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.576078 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:59.577073 29565 raft_consensus.cc:2379] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:10:59.580883 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.587399 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.587877 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.563709 688 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:59.596951 30273 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:59.601199 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.606510 29533 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.573421 691 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:59.578034 328 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:10:59.608068 328 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:10:59.608820 328 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:10:59.569017 32684 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:59.624559 32679 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:10:59.625469 32679 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:59.625885 29609 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.630407 547 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:10:59.632519 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.633199 640 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:59.566823 549 consensus_queue.cc:1046] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260807 15:10:59.572679 589 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:59.618270 30273 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:59.578986 661 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:59.621775 568 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:10:59.622139 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 147042us
I20260807 15:10:59.637310 29481 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.645982 29533 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:59.658308 29608 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:10:59.660604 29481 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.662104 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.663298 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:10:59.666039 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 96181.2us
I20260807 15:10:59.666721 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.666846 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.667187 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.670063 29531 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.636085 689 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260807 15:10:59.660166 708 log.cc:924] Time spent T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.061s user 0.000s sys 0.002s
I20260807 15:10:59.617164 683 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.676683 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:59.684387 29531 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.685467 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:10:59.678068 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 100303us
I20260807 15:10:59.665001 32637 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:10:59.665093 691 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:59.686615 30307 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:10:59.674939 568 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:10:59.704056 29531 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.671139 32703 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:10:59.745770 29531 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:10:59.686666 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 115730us
I20260807 15:10:59.678026 556 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:10:59.740149 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 63556.1us
I20260807 15:10:59.677788 637 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:59.671134 678 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.748011 29450 leader_election.cc:398] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:59.685953 627 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:59.687587 549 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:59.745677 636 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.753705 29450 leader_election.cc:401] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 15:10:59.759409 636 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.760274 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:10:59.761442 636 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.745115 558 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:10:59.762322 648 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:59.687621 32679 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:10:59.754487 690 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:10:59.757937 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:59.766913 29533 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:10:59.768114 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:10:59.792085 30310 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:10:59.745847 555 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:10:59.773702 638 raft_consensus.cc:3032] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Stepping down as leader of term 6
W20260807 15:10:59.779486 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 49832.5us
I20260807 15:10:59.780217 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.782147 29479 raft_consensus.cc:1226] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
W20260807 15:10:59.750577 653 consensus_meta.cc:287] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.944s user 0.005s sys 0.017s
I20260807 15:10:59.782897 32703 raft_consensus.cc:686] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:10:59.791478 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 2983) took 1012 ms. Trace:
I20260807 15:10:59.748705 691 raft_consensus.cc:686] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:59.799885 29533 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:10:59.753072 556 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:10:59.795113 638 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:10:59.831637 638 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.802953 29567 rpcz_store.cc:276] 0807 15:10:58.779170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:58.779296 (+ 126us) service_pool.cc:227] Handling call
0807 15:10:58.779578 (+ 282us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:10:58.804090 (+ 24512us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:10:58.804145 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:10:58.804213 (+ 68us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:10:58.804286 (+ 73us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:10:59.791193 (+986907us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54002ce7d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:10:59.791254 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:10:59.791403 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":55602944}
I20260807 15:10:59.762089 640 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4.
I20260807 15:10:59.832376 32703 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.839571 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:10:59.846593 556 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:10:59.846927 29570 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:59.841032 555 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:10:59.849458 555 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.850059 555 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
W20260807 15:10:59.856842 32694 consensus_meta.cc:287] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.553s user 0.015s sys 0.000s
I20260807 15:10:59.857537 649 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:10:59.858291 649 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.804227 690 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:10:59.861620 690 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:10:59.862365 690 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:10:59.808128 471 consensus_queue.cc:1046] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260807 15:10:59.865300 471 raft_consensus.cc:3032] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:59.865833 471 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:10:59.869418 537 consensus_queue.cc:1046] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:10:59.871042 674 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.812000 653 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.879602 29561 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 3. Current term is 4. Ops: []
I20260807 15:10:59.882511 29570 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:10:59.883884 691 consensus_queue.cc:237] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.887245 29450 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:10:59.866720 471 consensus_queue.cc:260] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.891669 494 raft_consensus.cc:2781] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:10:59.892920 494 raft_consensus.cc:686] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:10:59.896083 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 100024us
I20260807 15:10:59.895300 494 consensus_queue.cc:237] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:10:59.897684 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 60057.9us
W20260807 15:10:59.908514 681 log.cc:924] Time spent T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.338s user 0.000s sys 0.004s
I20260807 15:10:59.908376 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:10:59.914606 556 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:10:59.910477 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:10:59.919266 653 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.921167 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:59.935786 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:10:59.936906 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:10:59.938102 674 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.939793 29380 catalog_manager.cc:5495] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:59.941987 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:59.942258 29380 catalog_manager.cc:5495] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 3 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:10:59.895040 328 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:10:59.945688 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:10:59.947357 29380 catalog_manager.cc:5495] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 5 to 7, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 7 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:59.959182 638 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:10:59.965612 328 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.970247 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:10:59.971055 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:10:59.976322 29479 raft_consensus.cc:2379] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 4: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:10:59.955371 649 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:10:59.981308 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:10:59.988303 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:10:59.989241 29643 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:10:59.801851 30305 raft_consensus.cc:3032] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:10:59.990599 328 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:11:00.001950 29449 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:00.002578 29380 catalog_manager.cc:5495] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 4, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 4 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:00.005555 29380 catalog_manager.cc:5495] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 4, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:00.011806 29380 catalog_manager.cc:5495] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 6 to 7, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 7 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:00.013688 29380 catalog_manager.cc:5495] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 4 to 5, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 5 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:00.023049 29479 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:00.024325 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:00.025022 30310 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:11:00.019407 29380 catalog_manager.cc:5495] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 3, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 3 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:00.024892 32626 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260807 15:11:00.032476 29379 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48690 (request call id 388) took 11656 ms (client timeout 15000 ms). Trace:
I20260807 15:10:59.981312 690 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.029542 29380 catalog_manager.cc:5495] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 1 to 2, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 2 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:10:59.990655 30305 raft_consensus.cc:729] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:00.030828 568 raft_consensus.cc:686] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:00.042954 29380 catalog_manager.cc:5495] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:00.048354 29380 catalog_manager.cc:5495] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:00.048990 568 consensus_queue.cc:237] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.050290 29380 catalog_manager.cc:5495] T 0a0ef49386d543e6bf09732d79976e83 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:00.051987 659 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:00.032507 32626 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:00.055796 32626 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:11:00.062070 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 409750us
I20260807 15:11:00.077630 471 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:00.080240 29380 catalog_manager.cc:5495] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 3, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:00.094288 30305 consensus_queue.cc:260] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:00.032994 29379 rpcz_store.cc:269] 0807 15:10:48.375919 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:48.379448 (+ 3529us) service_pool.cc:227] Handling call
0807 15:10:48.779372 (+399924us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e1d1ed6c 00007f94e1e18c3e 00007f94e012afb4 00007f94e012af42 00007f94e012ae71 00007f94e012adec 00007f94e012a0a2 00007f94da1ee94c 00007f94da1edd86
0807 15:11:00.032392 (+11253020us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:10:56.351856 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:10:56.494674 (+142818us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:10:56.494761 (+ 87us) write_op.cc:435] Acquired schema lock
0807 15:10:56.494820 (+ 59us) tablet.cc:660] Decoding operations
0807 15:10:56.496291 (+ 1471us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:10:56.496457 (+ 166us) write_op.cc:641] Partition lock acquired for write op
0807 15:10:56.496531 (+ 74us) tablet.cc:683] Acquiring locks for 3 operations
0807 15:10:56.497382 (+ 851us) tablet.cc:699] Row locks acquired
0807 15:10:56.497426 (+ 44us) write_op.cc:260] PREPARE: finished
0807 15:10:56.497756 (+ 330us) write_op.cc:270] Start()
0807 15:10:56.497986 (+ 230us) write_op.cc:276] Timestamp: P: 1786115456497691 usec, L: 0
0807 15:10:56.498045 (+ 59us) op_driver.cc:331] REPLICATION: starting
0807 15:10:56.499638 (+ 1593us) log.cc:842] Serialized 1321 byte log entry
0807 15:10:56.909270 (+409632us) op_driver.cc:444] REPLICATION: finished
0807 15:10:57.118070 (+208800us) write_op.cc:301] APPLY: starting
0807 15:10:57.121153 (+ 3083us) tablet.cc:1365] starting BulkCheckPresence
0807 15:10:57.145240 (+ 24087us) tablet.cc:1368] finished BulkCheckPresence
0807 15:10:57.145526 (+ 286us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:10:57.146310 (+ 784us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:10:57.146647 (+ 337us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0807 15:10:57.146760 (+ 113us) write_op.cc:312] APPLY: finished
0807 15:10:57.147156 (+ 396us) log.cc:842] Serialized 35 byte log entry
0807 15:10:57.147435 (+ 279us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:57.147613 (+ 178us) write_op.cc:454] Released schema lock
0807 15:10:57.147681 (+ 68us) write_op.cc:341] FINISH: Updating metrics
0807 15:10:57.247822 (+100141us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:10:57.297760 (+ 49938us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36253,"reported_tablets":12,"spinlock_wait_cycles":128054528,"child_traces":[["op",{"apply.queue_time_us":195330,"apply.run_cpu_time_us":4440,"apply.run_wall_time_us":208890,"num_ops":3,"prepare.queue_time_us":218556,"prepare.run_cpu_time_us":7166,"prepare.run_wall_time_us":192287,"replication_time_us":408233,"thread_start_us":130757,"threads_started":2}]]}
I20260807 15:11:00.108589 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:00.109856 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:00.135736 29569 raft_consensus.cc:1226] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:00.086061 29380 catalog_manager.cc:5495] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 3, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:00.137776 29380 catalog_manager.cc:5495] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 5, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 5 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:00.110855 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:00.117338 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:00.135785 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 53485.8us
I20260807 15:11:00.141961 30273 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:00.150756 29380 catalog_manager.cc:5495] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:00.162837 29609 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:00.164062 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 45910.3us
I20260807 15:11:00.164459 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:00.165417 29567 raft_consensus.cc:1226] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:11:00.167274 29570 raft_consensus.cc:1226] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:00.171327 29560 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:00.183431 29569 raft_consensus.cc:1226] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:00.201306 29479 raft_consensus.cc:1226] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:00.173477 675 consensus_queue.cc:1046] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260807 15:11:00.166239 30305 raft_consensus.cc:3037] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:00.169785 665 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:11:00.217926 30273 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:00.192852 534 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:00.225798 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:00.232187 690 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:00.235773 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:00.161090 714 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:00.252919 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 47443.3us
I20260807 15:11:00.257567 602 raft_consensus.cc:3032] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:00.258239 602 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:00.246258 30312 raft_consensus.cc:2362] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7. Re-sending same reply.
I20260807 15:11:00.270665 29608 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:00.277226 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 59380.1us
I20260807 15:11:00.281455 595 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:11:00.314165 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 58134.4us
I20260807 15:11:00.326092 678 consensus_queue.cc:1046] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:11:00.327663 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:00.328949 32312 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:11:00.329842 32312 raft_consensus.cc:686] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:00.331478 32312 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.343245 700 consensus_queue.cc:1046] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:00.327716 678 raft_consensus.cc:3032] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:11:00.344918 678 raft_consensus.cc:729] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:00.345261 32679 raft_consensus.cc:3032] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:00.345902 32679 raft_consensus.cc:729] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:00.347950 32679 consensus_queue.cc:260] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.349859 29485 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:11:00.350366 32679 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:00.351541 690 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:00.304116 321 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260807 15:11:00.352161 32626 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.346922 678 consensus_queue.cc:260] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.362016 678 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:00.362200 29531 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:00.362999 32626 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:00.366091 328 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:11:00.369383 29531 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:00.381518 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:00.381353 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:00.259701 602 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.317905 534 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:00.266641 714 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.372720 568 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 15:11:00.386945 555 consensus_meta.cc:287] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.536s user 0.010s sys 0.010s
I20260807 15:11:00.395490 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:00.416047 30312 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:11:00.419991 602 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:11:00.476526 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 92124.2us
I20260807 15:11:00.385087 29531 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:00.425484 30303 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:11:00.481691 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 96535.4us
I20260807 15:11:00.407032 555 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.486321 32703 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260807 15:11:00.496565 688 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:00.497939 688 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.501482 638 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:00.531574 328 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:00.533260 328 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.495795 555 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:00.542609 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
W20260807 15:11:00.544262 723 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.100s user 0.000s sys 0.003s
I20260807 15:11:00.545531 328 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:00.558121 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:00.581708 30312 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:00.593266 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:00.597069 29564 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:11:00.598489 328 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:00.614428 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:00.616454 30305 raft_consensus.cc:2454] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
W20260807 15:11:00.619678 537 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260807 15:11:00.620712 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:00.634375 30303 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
W20260807 15:11:00.635497 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 49303.3us
I20260807 15:11:00.639130 32626 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:00.646420 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:00.653616 29645 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:00.657171 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:00.663587 30272 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:00.665072 602 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:00.655521 688 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:00.686303 29531 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:00.695324 29531 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:00.698863 328 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:00.702304 690 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:00.712363 714 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:00.724525 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 72703.8us
I20260807 15:11:00.735010 29567 raft_consensus.cc:1226] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:00.717429 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:00.721719 29452 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:11:00.754678 471 consensus_meta.cc:287] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.675s user 0.014s sys 0.023s
I20260807 15:11:00.756027 30312 raft_consensus.cc:1261] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260807 15:11:00.756402 30312 pending_rounds.cc:76] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Aborting all ops after (but not including) 6
I20260807 15:11:00.757941 30312 pending_rounds.cc:97] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260807 15:11:00.758292 30312 raft_consensus.cc:2866] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:11:00.763913 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:00.780334 563 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:00.783527 563 raft_consensus.cc:686] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:00.785149 563 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.788245 29531 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:00.789872 568 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:11:00.790759 29531 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:00.790861 568 raft_consensus.cc:686] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
W20260807 15:11:00.795604 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 74005.4us
I20260807 15:11:00.772264 714 consensus_queue.cc:1035] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260807 15:11:00.794500 690 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:00.824554 568 consensus_queue.cc:237] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:00.846419 30304 raft_consensus.cc:1261] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:11:00.853601 645 consensus_queue.cc:1035] T f4c7484fae4742a2a93ad8d15ee4241c P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:00.854944 29569 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 15:11:00.871482 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:00.873873 29484 raft_consensus.cc:1261] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:00.885239 714 consensus_queue.cc:1035] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260807 15:11:00.964998 30312 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:00.966533 29481 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:01.013424 702 consensus_queue.cc:1046] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260807 15:11:01.014503 405 consensus_queue.cc:1046] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 15:11:01.015043 702 raft_consensus.cc:3032] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:01.015865 405 raft_consensus.cc:3032] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:01.016348 405 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:01.017409 405 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.018836 405 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:01.036540 32679 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:11:01.015718 702 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:01.062561 702 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.064078 702 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:01.130648 29380 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 220) took 5823 ms. Trace:
I20260807 15:11:01.131139 29380 rpcz_store.cc:276] 0807 15:10:55.338512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:55.344910 (+ 6398us) service_pool.cc:227] Handling call
0807 15:11:01.130379 (+5785469us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:11:00.439201 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:11:00.439858 (+ 657us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:11:00.439883 (+ 25us) write_op.cc:435] Acquired schema lock
0807 15:11:00.439934 (+ 51us) tablet.cc:660] Decoding operations
0807 15:11:00.440827 (+ 893us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:11:00.440876 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0807 15:11:00.440898 (+ 22us) tablet.cc:683] Acquiring locks for 16 operations
0807 15:11:00.441615 (+ 717us) tablet.cc:699] Row locks acquired
0807 15:11:00.441624 (+ 9us) write_op.cc:260] PREPARE: finished
0807 15:11:00.441739 (+ 115us) write_op.cc:270] Start()
0807 15:11:00.441824 (+ 85us) write_op.cc:276] Timestamp: P: 1786115460441699 usec, L: 0
0807 15:11:00.441834 (+ 10us) op_driver.cc:331] REPLICATION: starting
0807 15:11:00.442406 (+ 572us) log.cc:842] Serialized 6458 byte log entry
0807 15:11:00.710078 (+267672us) op_driver.cc:444] REPLICATION: finished
0807 15:11:00.892809 (+182731us) write_op.cc:301] APPLY: starting
0807 15:11:00.892946 (+ 137us) tablet.cc:1365] starting BulkCheckPresence
0807 15:11:00.897119 (+ 4173us) tablet.cc:1368] finished BulkCheckPresence
0807 15:11:00.901508 (+ 4389us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:11:00.971952 (+ 70444us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:11:00.972488 (+ 536us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0807 15:11:00.972570 (+ 82us) write_op.cc:312] APPLY: finished
0807 15:11:00.973160 (+ 590us) log.cc:842] Serialized 113 byte log entry
0807 15:11:00.973390 (+ 230us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:00.973894 (+ 504us) write_op.cc:454] Released schema lock
0807 15:11:00.973969 (+ 75us) write_op.cc:341] FINISH: Updating metrics
0807 15:11:00.975773 (+ 1804us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:00.975824 (+ 51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":527473,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":175742,"apply.run_cpu_time_us":8405,"apply.run_wall_time_us":83804,"num_ops":16,"prepare.queue_time_us":164512,"prepare.run_cpu_time_us":4374,"prepare.run_wall_time_us":4388,"raft.queue_time_us":128109,"raft.run_cpu_time_us":20928,"raft.run_wall_time_us":107170,"replication_time_us":255794,"thread_start_us":303680,"threads_started":4,"wal-append.queue_time_us":1223}]]}
I20260807 15:11:01.192888 29645 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46792
I20260807 15:11:01.193732 29645 raft_consensus.cc:595] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Received request to transfer leadership
I20260807 15:11:01.192006 29378 catalog_manager.cc:5495] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 7, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 7 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.195708 29378 catalog_manager.cc:5495] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 5, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 5 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } }
I20260807 15:11:01.197409 29378 catalog_manager.cc:5495] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 5, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.203737 714 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:01.204363 714 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.206666 714 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.207842 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:01.208601 30311 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:01.204864 29378 catalog_manager.cc:5495] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.209853 29533 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:01.215107 714 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:01.220191 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:01.222434 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:11:01.236593 547 raft_consensus.cc:979] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:01.237299 547 raft_consensus.cc:1067] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:01.218142 714 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:01.239353 714 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:01.247215 29641 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46792
I20260807 15:11:01.248063 29641 raft_consensus.cc:595] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Received request to transfer leadership
I20260807 15:11:01.251549 30312 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:01.238817 29378 catalog_manager.cc:5495] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 6, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.264708 29378 catalog_manager.cc:5495] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 6, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.273066 29567 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:11:01.278978 29567 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:11:01.279387 29567 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:01.279637 29378 catalog_manager.cc:5495] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.281278 29378 catalog_manager.cc:5495] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.289535 30305 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 15:11:01.294045 714 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.295877 645 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:11:01.299189 29567 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.317021 29567 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.318547 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:01.319340 29481 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:11:01.320287 29365 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 46416.1us
I20260807 15:11:01.282903 29378 catalog_manager.cc:5495] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 6, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.321672 29641 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:46792
I20260807 15:11:01.323567 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:01.325194 29641 raft_consensus.cc:595] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Received request to transfer leadership
I20260807 15:11:01.325724 29645 raft_consensus.cc:3032] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:01.326079 29645 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:01.326861 29645 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.329272 29645 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:01.328588 29378 catalog_manager.cc:5495] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 6 to 7, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 7 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.330811 29378 catalog_manager.cc:5495] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 4 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } }
I20260807 15:11:01.325839 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:01.332345 30304 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:01.332477 714 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.333639 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:01.334280 30311 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:11:01.344739 29432 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for 1177fe2445db43e2b8366f33a841a041 already in progress
W20260807 15:11:01.345261 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 1177fe2445db43e2b8366f33a841a041 already in progress
I20260807 15:11:01.346441 30311 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:01.348026 30312 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:11:01.349016 29533 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:01.353412 30304 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:01.353889 537 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:01.354789 555 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:01.355397 555 raft_consensus.cc:686] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:01.356431 555 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.354452 537 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.362840 29641 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 15:11:01.363299 537 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:01.345635 29481 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:01.367762 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:01.368873 32626 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:11:01.369581 32626 consensus_queue.cc:1225] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer 4b092f7f951b4137b5d7810056684270 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260807 15:11:01.351050 29645 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:01.373867 29533 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:01.375039 690 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:01.375715 690 raft_consensus.cc:686] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:01.376780 690 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.377705 29640 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:11:01.379868 714 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:11:01.381309 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:01.384200 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:01.384581 29640 raft_consensus.cc:1203] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-8.9] Dedup: 5.7->[6.8-8.9]
I20260807 15:11:01.384909 29641 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:11:01.385198 29640 pending_rounds.cc:76] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Aborting all ops after (but not including) 7
I20260807 15:11:01.385885 30272 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:01.387214 602 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:01.387571 602 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:01.387883 602 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:01.386178 29640 pending_rounds.cc:97] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260807 15:11:01.388978 29640 raft_consensus.cc:2866] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:11:01.396811 547 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:01.397589 547 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.402148 547 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.401880 328 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:01.402356 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:01.403179 30312 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:11:01.408943 29609 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:01.412314 32765 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:11:01.412894 32765 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:01.413411 32765 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:01.423728 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:01.424875 29570 raft_consensus.cc:2379] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:01.429778 602 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.431259 30304 raft_consensus.cc:1226] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260807 15:11:01.432924 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:01.435600 714 consensus_queue.cc:1046] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:01.437609 328 raft_consensus.cc:3032] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:01.438082 328 raft_consensus.cc:729] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:01.439131 328 consensus_queue.cc:260] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.440418 328 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:01.396112 29378 catalog_manager.cc:5495] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 5, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.470427 602 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:01.474788 29479 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:11:01.475522 29479 raft_consensus.cc:595] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:01.477128 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:01.479069 29378 catalog_manager.cc:5495] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.481735 30272 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:01.485139 537 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:11:01.494180 29479 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:11:01.494916 29479 raft_consensus.cc:595] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:01.495267 29479 raft_consensus.cc:603] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:11:01.481686 32765 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.498399 29640 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:01.499025 29640 raft_consensus.cc:595] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:01.500381 380 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:01.484654 29378 catalog_manager.cc:5495] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.501034 380 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.502311 29378 catalog_manager.cc:5495] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.503165 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:01.512408 29378 catalog_manager.cc:5495] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 4 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.514597 29378 catalog_manager.cc:5495] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.516374 29378 catalog_manager.cc:5495] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 5, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:01.517638 29481 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d87368aeb34548079f36255279bee400"
dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
mode: GRACEFUL
new_leader_uuid: "4b092f7f951b4137b5d7810056684270"
from {username='slave'} at 127.0.0.1:32796
I20260807 15:11:01.518406 29481 raft_consensus.cc:595] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Received request to transfer leadership to TS 4b092f7f951b4137b5d7810056684270
I20260807 15:11:01.518385 29378 catalog_manager.cc:5495] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:01.520491 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 15:11:01.522552 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:11:01.523321 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:11:01.504276 380 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.507682 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:01.527525 29564 raft_consensus.cc:2379] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:01.508034 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:01.528851 30312 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:01.509117 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:01.529794 29609 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:01.530253 29570 raft_consensus.cc:2379] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:01.509747 32765 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.530851 32765 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:01.531229 32765 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:01.531595 32765 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:01.539568 32765 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.544100 29378 catalog_manager.cc:5495] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 2 to 4, leader changed from 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 4 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } }
I20260807 15:11:01.549507 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:01.550396 29570 raft_consensus.cc:2379] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:01.552436 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:01.559433 32765 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.560362 547 raft_consensus.cc:979] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:01.561003 547 raft_consensus.cc:1067] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:01.563946 29570 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:11:01.564523 29570 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:11:01.564893 29570 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:01.572767 30304 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:11:01.727008 30304 consensus_queue.cc:237] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.728304 32679 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:01.741333 29570 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.754880 30312 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:01.770352 29570 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.785180 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:01.785962 30312 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:01.773929 32679 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:01.797541 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 63126.3us
I20260807 15:11:01.812146 30312 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:01.813110 29609 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:01.822962 29609 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:01.805696 32679 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:01.836058 758 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:11:01.846684 29533 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:01.849431 30312 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260807 15:11:01.854954 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 86097.2us
W20260807 15:11:01.864151 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 48930.6us
I20260807 15:11:01.854588 405 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:11:01.874246 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:01.882217 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:01.882930 29640 raft_consensus.cc:3032] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:01.882838 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:01.883467 29640 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:01.883994 30312 raft_consensus.cc:2354] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8.
I20260807 15:11:01.884382 29640 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.885010 405 raft_consensus.cc:686] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:01.864878 328 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:11:01.865911 758 raft_consensus.cc:686] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:01.890647 29645 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 8
I20260807 15:11:01.898481 29640 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:01.866690 555 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260807 15:11:01.895958 328 raft_consensus.cc:686] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:01.929065 29647 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 15:11:01.886168 405 consensus_queue.cc:237] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:01.930814 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 111899us
I20260807 15:11:01.947484 29640 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:02.007400 29645 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 15:11:01.968026 328 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:01.998792 758 consensus_queue.cc:237] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:02.266137 29481 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260807 15:11:02.310470 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 328783us
I20260807 15:11:02.328691 32703 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:02.331758 32703 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:02.340451 32703 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:02.351082 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 332282us
W20260807 15:11:02.369731 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 105985us
I20260807 15:11:02.383800 770 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260807 15:11:02.387662 770 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260807 15:11:02.448261 29609 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.552s user 0.026s sys 0.020s
W20260807 15:11:02.448699 29609 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.553s user 0.026s sys 0.020s
I20260807 15:11:02.453815 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:02.454392 29609 leader_election.cc:398] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8.
I20260807 15:11:02.454735 29609 leader_election.cc:401] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:11:02.461717 758 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8.
I20260807 15:11:02.465713 714 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260807 15:11:02.562522 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 85762.2us
I20260807 15:11:02.563218 765 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:02.581868 765 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:02.586879 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:02.587694 29640 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:02.589149 30272 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:11:02.594242 29532 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.621s user 0.022s sys 0.034s
W20260807 15:11:02.594640 29532 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.624s user 0.022s sys 0.034s
I20260807 15:11:02.598363 714 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:02.598898 714 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:02.601053 714 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:02.601853 30308 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260807 15:11:02.606087 29450 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.639s user 0.017s sys 0.009s
W20260807 15:11:02.606596 29450 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.658s user 0.018s sys 0.009s
W20260807 15:11:02.606940 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 661125us
I20260807 15:11:02.608645 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:02.609406 29564 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 9.
I20260807 15:11:02.611354 678 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:02.614591 765 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:02.617468 30304 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s user 0.006s sys 0.009s
W20260807 15:11:02.617867 30304 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s user 0.006s sys 0.009s
I20260807 15:11:02.619009 678 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:02.620366 678 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:02.641211 30308 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:11:02.654239 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:02.654990 30308 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
W20260807 15:11:02.665154 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 684148us
I20260807 15:11:02.668951 690 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:11:02.675501 29533 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:02.677457 690 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:02.677946 690 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:02.678320 690 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:02.681031 678 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:02.684865 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 60506us
I20260807 15:11:02.702085 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:02.703161 29560 raft_consensus.cc:2379] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 9: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:02.702652 32703 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:02.708211 520 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:02.708891 520 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:02.710628 29608 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:02.711354 520 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:02.724946 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:02.733386 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:02.734329 29570 raft_consensus.cc:2379] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 9: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:02.736618 30305 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:02.730407 678 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:02.736929 690 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:02.741019 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:02.752413 30305 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:11:02.714702 751 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:02.826243 29560 raft_consensus.cc:1261] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:11:02.757460 29485 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:02.848721 328 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:02.823948 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:02.841295 753 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s user 0.004s sys 0.042s
I20260807 15:11:02.822535 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:02.788730 32694 raft_consensus.cc:979] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
W20260807 15:11:02.852043 753 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s user 0.006s sys 0.042s
I20260807 15:11:02.853021 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:02.853785 30304 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:02.819404 690 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:02.756253 752 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
W20260807 15:11:02.864109 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 106297us
W20260807 15:11:02.865012 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 105916us
I20260807 15:11:02.867545 650 raft_consensus.cc:1067] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:02.823423 29646 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 15:11:02.923944 29640 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:02.929220 29570 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59890
I20260807 15:11:02.930146 29570 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:11:02.930668 29570 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:02.953446 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:02.959672 30272 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
W20260807 15:11:02.967798 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 44131.6us
I20260807 15:11:02.995509 29564 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:02.993995 30304 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:02.997893 29533 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:02.992308 29449 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:02.980121 32765 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:02.988225 750 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 15:11:03.008575 29570 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.003288 645 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:02.989876 714 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260807 15:11:03.010414 32765 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.024329 755 consensus_queue.cc:1035] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260807 15:11:03.018512 770 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:11:03.020426 30303 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260807 15:11:03.019114 750 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:03.047278 632 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:03.047971 770 raft_consensus.cc:686] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
W20260807 15:11:03.057053 787 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.159s user 0.003s sys 0.000s
I20260807 15:11:03.035970 29570 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:03.049365 770 consensus_queue.cc:237] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.218608 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 15:11:03.199849 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 74805.1us
I20260807 15:11:03.128985 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:03.257344 30309 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:03.255190 29560 raft_consensus.cc:2932] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:03.259472 328 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:03.260149 328 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.143039 380 consensus_queue.cc:1046] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
W20260807 15:11:03.166211 789 log.cc:924] Time spent T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260807 15:11:03.163645 32765 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:03.093580 405 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:03.266232 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:03.262948 765 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:03.268460 328 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:03.271114 380 raft_consensus.cc:3032] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:03.139528 632 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:03.261219 714 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:03.296952 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:03.304481 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:03.325826 29643 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:03.327293 29531 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:03.322863 30309 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:03.332243 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:03.332877 29486 raft_consensus.cc:3032] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:03.336012 792 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:03.336527 792 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:03.336894 792 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:03.294050 405 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.331432 714 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.317780 380 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:03.344781 714 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:03.344959 380 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.346088 405 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:03.346349 380 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:11:03.347508 791 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.217s user 0.000s sys 0.004s
I20260807 15:11:03.333251 29486 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:03.362118 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:03.362146 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:03.323472 632 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:03.354485 29486 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.363845 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:03.368160 29486 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:03.381789 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:03.295653 765 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:03.380426 30337 debug-util.cc:398] Leaking SignalData structure 0x7b0800282ce0 after lost signal to thread 28230
I20260807 15:11:03.377465 751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54176 (request call id 12) took 1723 ms. Trace:
I20260807 15:11:03.404138 29486 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:03.165163 750 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:03.516625 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 131068us
W20260807 15:11:03.718245 30337 debug-util.cc:398] Leaking SignalData structure 0x7b08002456e0 after lost signal to thread 29417
W20260807 15:11:03.720062 30337 debug-util.cc:398] Leaking SignalData structure 0x7b0800209ac0 after lost signal to thread 29514
W20260807 15:11:03.720541 30337 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7560 after lost signal to thread 29515
W20260807 15:11:03.719329 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 332768us
I20260807 15:11:03.727800 30311 raft_consensus.cc:2379] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
W20260807 15:11:03.730412 30337 debug-util.cc:398] Leaking SignalData structure 0x7b0800391460 after lost signal to thread 29594
W20260807 15:11:03.730849 30337 debug-util.cc:398] Leaking SignalData structure 0x7b0800391340 after lost signal to thread 29595
W20260807 15:11:03.731712 30337 debug-util.cc:398] Leaking SignalData structure 0x7b080028d5c0 after lost signal to thread 29674
W20260807 15:11:03.732002 30337 debug-util.cc:398] Leaking SignalData structure 0x7b0800322760 after lost signal to thread 29676
W20260807 15:11:03.732909 30337 debug-util.cc:398] Leaking SignalData structure 0x7b0800208cc0 after lost signal to thread 30341
W20260807 15:11:03.733125 30337 debug-util.cc:398] Leaking SignalData structure 0x7b08002d58c0 after lost signal to thread 30342
W20260807 15:11:03.733477 30337 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb6c0 after lost signal to thread 602
W20260807 15:11:03.751034 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 429807us
W20260807 15:11:03.816399 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 86597.3us
W20260807 15:11:03.817023 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 79637.3us
I20260807 15:11:03.402541 792 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:03.892436 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:03.893124 802 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.106s user 0.001s sys 0.000s
W20260807 15:11:03.896184 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 73031.4us
I20260807 15:11:03.913422 29566 raft_consensus.cc:1226] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:03.930697 29564 raft_consensus.cc:2354] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7.
W20260807 15:11:03.943109 805 log.cc:924] Time spent T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.117s user 0.000s sys 0.000s
W20260807 15:11:03.946779 632 consensus_meta.cc:287] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.582s user 0.009s sys 0.000s
I20260807 15:11:03.543864 751 rpcz_store.cc:276] 0807 15:11:01.629088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:01.638071 (+ 8983us) service_pool.cc:227] Handling call
0807 15:11:01.783906 (+145835us) log.cc:842] Serialized 508 byte log entry
0807 15:11:03.352436 (+1568530us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":811988,"threads_started":1,"wal-append.queue_time_us":283975,"wal-append.run_cpu_time_us":2095,"wal-append.run_wall_time_us":1010386}
I20260807 15:11:03.955796 792 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:03.965082 765 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:03.967012 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:03.968371 714 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:03.969053 714 raft_consensus.cc:686] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:03.970284 714 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.061970 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:04.007861 380 consensus_meta.cc:287] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.661s user 0.011s sys 0.000s
I20260807 15:11:03.947381 632 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.262034 809 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:04.267688 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 370507us
I20260807 15:11:04.271100 792 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:04.271477 762 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.262848 809 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:04.269686 30272 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.006s sys 0.014s
W20260807 15:11:04.277439 30272 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.601s user 0.006s sys 0.014s
W20260807 15:11:04.276680 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 392468us
I20260807 15:11:04.282505 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:04.285110 29647 raft_consensus.cc:2396] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260807 15:11:04.285602 632 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:04.288091 809 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:04.289986 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:04.276852 792 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.293453 792 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:04.283479 762 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.298453 762 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:04.299420 29563 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.541s user 0.004s sys 0.007s
I20260807 15:11:04.323390 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:04.325205 812 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.325626 30272 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:04.325845 812 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.326501 765 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:04.326663 792 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:04.327247 792 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:04.329533 792 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:04.332196 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:04.333207 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:04.350816 29533 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:04.370672 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:04.375438 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:04.337340 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:04.388654 29609 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:04.374465 812 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:04.424403 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 83293.1us
W20260807 15:11:04.505965 818 log.cc:924] Time spent T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.082s user 0.000s sys 0.000s
I20260807 15:11:04.507282 29644 raft_consensus.cc:1226] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 9. Current term is 10. Ops: []
I20260807 15:11:04.426146 762 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.508286 820 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.508667 762 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.508924 820 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:04.511456 820 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:04.514645 405 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:04.511567 762 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:04.512995 816 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
I20260807 15:11:04.536976 750 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.563180 555 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.577149 762 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:04.652396 762 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.653137 794 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:04.654007 794 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.655375 762 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:04.650887 811 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.657016 811 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.666136 830 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:04.666846 830 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:04.675983 821 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:04.677122 821 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:04.642230 555 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:04.638633 814 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:04.697067 814 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:04.711874 555 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:04.640036 750 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:04.864549 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 427492us
W20260807 15:11:04.865957 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 484268us
W20260807 15:11:04.909849 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 44111.2us
I20260807 15:11:04.641002 820 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.763481 811 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:04.922524 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 494777us
W20260807 15:11:04.967984 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 57001.1us
I20260807 15:11:04.917018 762 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.946950 832 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.922160 837 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.943341 814 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:04.957078 838 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:04.975342 405 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:04.924281 820 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.019714 750 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.020605 750 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:05.021347 845 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.021308 750 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.022245 845 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.011814 555 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.024511 555 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.027321 555 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.030545 750 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:04.982057 762 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.041787 762 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:05.042309 796 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.042979 796 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:05.045306 29564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 3132) took 1689 ms (client timeout 1645 ms). Trace:
I20260807 15:11:05.018064 794 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:05.045912 29564 rpcz_store.cc:269] 0807 15:11:03.355842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:03.356013 (+ 171us) service_pool.cc:227] Handling call
0807 15:11:05.044982 (+1688969us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54002c56d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:05.045171 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1279255936}
I20260807 15:11:05.052965 845 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:04.984112 821 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:04.919765 835 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.012523 837 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.037554 820 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.011291 832 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.045747 830 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.016788 405 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.063843 832 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.045322 796 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.015638 838 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.065074 847 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.065646 847 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.066406 838 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.067265 838 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.067843 838 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.068629 830 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.069205 830 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.070464 838 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.067876 847 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.071274 830 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.071269 844 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.074132 844 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.059965 835 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.079201 835 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.079620 30305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54176 (request call id 14) took 2220 ms. Trace:
I20260807 15:11:05.080047 30305 rpcz_store.cc:276] 0807 15:11:02.859554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:02.859768 (+ 214us) service_pool.cc:227] Handling call
0807 15:11:05.079043 (+2219275us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540073d054. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e0d09c6e 00007f94da400807 00007f94da400792 00007f94da4006c1 00007f94da40063c 00007f94da3ff8f2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:05.079533 (+ 490us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2509684608}
I20260807 15:11:05.080993 837 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.058785 555 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.082221 555 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.084276 29367 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260807 15:11:05.084640 555 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:05.086073 30311 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48588 (request call id 936) took 1832 ms (client timeout 1645 ms). Trace:
I20260807 15:11:05.086917 405 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:05.091151 29485 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.790s user 0.008s sys 0.074s
W20260807 15:11:05.086580 30311 rpcz_store.cc:269] 0807 15:11:03.253951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:03.264829 (+ 10878us) service_pool.cc:227] Handling call
0807 15:11:05.085795 (+1820966us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540074d1d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:05.085962 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1024100608}
I20260807 15:11:05.095182 844 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:05.098637 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 119962us
W20260807 15:11:05.114470 29485 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.814s user 0.009s sys 0.075s
I20260807 15:11:05.096930 794 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.138067 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:05.142458 405 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.142819 832 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.143081 405 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.143496 832 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.145768 405 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.146482 834 consensus_queue.cc:1046] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260807 15:11:05.148334 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:05.149173 29643 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 7
I20260807 15:11:05.149286 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.152307 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.153076 29640 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:05.153960 826 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.154343 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:05.154502 826 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.155098 29568 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:11:05.156474 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:05.157191 29566 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
I20260807 15:11:05.148460 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.157456 830 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.158160 29646 raft_consensus.cc:2379] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 10: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:05.131613 794 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.145831 832 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.131742 796 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.158176 830 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.177017 380 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:05.177614 380 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.172116 820 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.175561 830 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.183048 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:05.195783 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.196121 755 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:05.196280 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.196651 29641 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:05.196943 755 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.197630 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.198767 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.198998 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.199447 29641 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:11:05.200426 755 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.200675 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.200928 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.202412 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.204687 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.204980 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:05.205768 30305 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:05.206143 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.206769 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.207273 30272 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:05.207438 29645 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 7.
I20260807 15:11:05.207535 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.208397 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.209031 29640 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:05.209085 29644 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:11:05.210414 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.211259 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:05.204700 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.212175 30305 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 2.
I20260807 15:11:05.215076 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:05.215095 30272 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:05.182539 826 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.192031 29643 raft_consensus.cc:2454] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:05.218729 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.218583 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.219515 29641 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 7.
I20260807 15:11:05.222736 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.219100 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:05.179687 380 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.165887 847 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.179500 820 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.250720 29645 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:05.230216 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:05.249670 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3127) took 1876 ms. Trace:
I20260807 15:11:05.248979 830 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.254061 29563 rpcz_store.cc:276] 0807 15:11:03.352813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:03.352945 (+ 132us) service_pool.cc:227] Handling call
0807 15:11:03.363973 (+ 11028us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 15:11:04.299876 (+935903us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:04.299931 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 15:11:04.331643 (+ 31712us) log.cc:842] Serialized 52 byte log entry
0807 15:11:04.363467 (+ 31824us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:04.920733 (+557266us) log.cc:842] Serialized 14 byte log entry
0807 15:11:05.143606 (+222873us) log.cc:842] Serialized 14 byte log entry
0807 15:11:05.229022 (+ 85416us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:05.229141 (+ 119us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:05.229202 (+ 61us) raft_consensus.cc:1671] finished
0807 15:11:05.229221 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:05.229412 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":333557,"prepare.queue_time_us":561630,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":92,"raft.queue_time_us":474333,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":21229,"spinlock_wait_cycles":8448,"thread_start_us":1491748,"threads_started":4,"wal-append.queue_time_us":84443}
I20260807 15:11:05.254191 30305 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:05.228794 838 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.240101 792 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:05.255496 830 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.192116 796 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.213660 844 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.228497 690 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.280552 29485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2277) took 1978 ms. Trace:
I20260807 15:11:05.281101 29485 rpcz_store.cc:276] 0807 15:11:03.296378 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:03.299990 (+ 3612us) service_pool.cc:227] Handling call
0807 15:11:03.300306 (+ 316us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:03.300504 (+ 198us) raft_consensus.cc:1520] Early marking committed up to index 8
0807 15:11:05.126614 (+1826110us) log.cc:842] Serialized 14 byte log entry
0807 15:11:05.274552 (+147938us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:05.274627 (+ 75us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:11:05.274688 (+ 61us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:05.274775 (+ 87us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:05.274940 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":137667,"prepare.queue_time_us":633321,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":138345,"thread_start_us":1823991,"threads_started":2,"wal-append.queue_time_us":114004}
W20260807 15:11:05.284122 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 43898.1us
I20260807 15:11:05.285768 29640 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:05.253746 847 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.287289 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:05.299199 30272 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:11:05.281706 29608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.645s (SENT) [suppressed 1 similar messages]
I20260807 15:11:05.279641 834 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:05.278889 844 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.279805 690 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.326691 847 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.327030 690 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.327653 854 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.327992 841 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.328253 854 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:05.328701 841 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.330163 854 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:11:05.330387 520 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:05.331241 841 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.331003 520 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.332952 860 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:05.333472 860 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.333683 520 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.306360 856 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.304695 826 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.334554 856 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.308696 850 raft_consensus.cc:3032] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 15:11:05.335711 850 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:05.336198 759 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:05.337155 856 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.306953 846 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:05.336735 850 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.338383 850 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:05.337985 846 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.312741 830 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.287760 835 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:05.289693 794 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.340225 794 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:05.270526 838 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.340559 846 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.341161 835 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.341663 835 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:05.309229 851 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.343549 851 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.346098 851 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.305603 834 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.347218 834 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:05.350883 768 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.333925 860 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:05.336804 759 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.339962 30272 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:05.354058 759 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.354684 759 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:05.355273 759 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.357865 759 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.327195 844 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.364442 838 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.334659 826 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.371315 866 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.322683 820 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.365005 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:05.415589 870 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:05.357057 547 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.105511 547 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.314704 796 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:05.351538 768 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:05.434804 864 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:07.160382 864 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.438036 865 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.440083 874 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:05.426584 866 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.622644 834 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.161190 874 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.639514 32626 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.641369 826 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.340607 794 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:05.661229 877 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:05.664479 860 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.665441 878 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.666246 835 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:05.668170 880 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:05.677076 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:05.677994 879 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.161875 865 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:07.168941 29482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3040) took 1492 ms (client timeout 1718 ms). Trace:
I20260807 15:11:07.168771 879 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:05.678541 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.170114 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3041) took 1492 ms. Trace:
I20260807 15:11:07.170745 865 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.679993 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:05.678990 881 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.171271 879 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:07.171674 29487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3043) took 1492 ms (client timeout 1736 ms). Trace:
I20260807 15:11:05.681938 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.171597 881 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:07.172614 29484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3042) took 1493 ms (client timeout 1981 ms). Trace:
I20260807 15:11:07.164429 32626 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:07.173050 29484 rpcz_store.cc:269] 0807 15:11:05.679146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.681696 (+ 2550us) service_pool.cc:227] Handling call
0807 15:11:07.172553 (+1490857us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.173946 881 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.695011 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.174234 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:05.690887 882 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.174656 30303 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:07.174844 32626 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:05.693243 883 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.701745 885 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.695286 850 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:05.702857 886 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.175696 885 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.176249 886 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.176659 864 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:07.175082 882 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.178134 885 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.178349 886 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:05.716497 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.178642 885 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:05.825166 811 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:06.420146 29511 debug-util.cc:398] Leaking SignalData structure 0x7b080010ffe0 after lost signal to thread 28230
I20260807 15:11:07.169485 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.163278 866 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.179919 811 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:06.046404 822 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:06.746433 29533 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.491s user 0.014s sys 0.017s
W20260807 15:11:07.180989 29533 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.925s user 0.014s sys 0.018s
I20260807 15:11:07.167073 880 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.181042 822 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:06.970026 870 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:06.972057 814 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:07.197489 814 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.197908 814 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:07.197929 30305 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260807 15:11:07.198853 870 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:07.199340 30305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 751) took 1505 ms. Trace:
I20260807 15:11:07.199847 30305 rpcz_store.cc:276] 0807 15:11:05.693564 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:06.745156 (+1051592us) service_pool.cc:227] Handling call
0807 15:11:06.745676 (+ 520us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.198479 (+452803us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.199096 (+ 617us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54005afd54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.199278 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1039221120}
I20260807 15:11:07.200721 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3033) took 1531 ms. Trace:
I20260807 15:11:07.201464 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.201138 29481 rpcz_store.cc:276] 0807 15:11:05.669610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.669728 (+ 118us) service_pool.cc:227] Handling call
0807 15:11:05.675336 (+ 5608us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.175641 (+1500305us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.175671 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.175712 (+ 41us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:07.175747 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.200496 (+ 24749us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540018fbd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.200547 (+ 51us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.200659 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3450024320}
W20260807 15:11:07.202415 30305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39994 (request call id 1427) took 1505 ms (client timeout 1820 ms). Trace:
I20260807 15:11:07.202795 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.199412 822 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:06.976351 30310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1422) took 2700 ms. Trace:
W20260807 15:11:07.202811 30305 rpcz_store.cc:269] 0807 15:11:05.697216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.201203 (+1503987us) service_pool.cc:227] Handling call
0807 15:11:07.202363 (+ 1160us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:06.989084 29531 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.729s user 0.031s sys 0.018s
W20260807 15:11:07.204883 29531 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.945s user 0.032s sys 0.018s
I20260807 15:11:07.204668 886 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:07.205389 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 1.96489e+06us
I20260807 15:11:07.205518 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:07.206243 30305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39994 (request call id 1430) took 1508 ms (client timeout 1871 ms). Trace:
I20260807 15:11:07.206452 32626 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:07.206583 30305 rpcz_store.cc:269] 0807 15:11:05.698261 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.205112 (+1506851us) service_pool.cc:227] Handling call
0807 15:11:07.206183 (+ 1071us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.207036 29531 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:07.206985 32626 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:06.970057 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 1.60503e+06us
I20260807 15:11:07.207712 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.208307 29609 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:11:06.996878 30273 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.770s user 0.018s sys 0.021s
I20260807 15:11:06.997918 650 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:07.001070 770 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.681s user 0.010s sys 0.023s
I20260807 15:11:07.003334 896 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.003655 30309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 753) took 1309 ms. Trace:
I20260807 15:11:07.004133 893 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.214872 821 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 15:11:07.005539 894 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.214974 893 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.216046 894 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.217705 893 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.218248 894 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.022722 380 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:07.218456 896 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.219012 380 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.021778 520 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.063943 30304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 755) took 1369 ms. Trace:
I20260807 15:11:07.221190 380 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.221731 30304 rpcz_store.cc:276] 0807 15:11:05.694814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.062836 (+1368022us) service_pool.cc:227] Handling call
0807 15:11:07.063224 (+ 388us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.063457 (+ 233us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.063494 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.063551 (+ 57us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:07.063595 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.063686 (+ 91us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.063838 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.221295 29382 catalog_manager.cc:5495] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: term changed from 3 to 6, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 6 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:11:07.221158 896 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.222998 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.075309 30311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 752) took 1381 ms. Trace:
I20260807 15:11:07.083159 30308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1423) took 1387 ms. Trace:
I20260807 15:11:07.224032 30311 rpcz_store.cc:276] 0807 15:11:05.693894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.074439 (+1380545us) service_pool.cc:227] Handling call
0807 15:11:07.074771 (+ 332us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.074956 (+ 185us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.074984 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.075026 (+ 42us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:07.075058 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.075110 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.075235 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.225384 29485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3030) took 1556 ms. Trace:
I20260807 15:11:07.225569 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.225835 29485 rpcz_store.cc:276] 0807 15:11:05.668809 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.668913 (+ 104us) service_pool.cc:227] Handling call
0807 15:11:07.009312 (+1340399us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b5800001898. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d1a2b0 00007f94e0d057f9 00007f94e0d052a2 00007f94da3eb684
0807 15:11:07.009623 (+ 311us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.224221 (+214598us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.224261 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.224313 (+ 52us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:07.224351 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.225106 (+ 755us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003ae8d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.225160 (+ 54us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.225317 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":497454848}
I20260807 15:11:07.226925 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:07.118314 29608 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.805s user 0.005s sys 0.032s
I20260807 15:11:07.120755 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.123252 763 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.126513 764 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:07.232578 32626 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.133128 751 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:07.232905 764 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.233661 751 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.235101 764 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:07.129618 29534 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.870s user 0.017s sys 0.014s
I20260807 15:11:07.235651 751 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:07.142288 29532 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.925s user 0.030s sys 0.044s
I20260807 15:11:07.147368 678 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.170877 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3031) took 1501 ms. Trace:
I20260807 15:11:07.172115 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3037) took 1501 ms. Trace:
W20260807 15:11:07.175166 30303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48584 (request call id 754) took 1480 ms (client timeout 1918 ms). Trace:
I20260807 15:11:05.696605 884 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:07.239249 678 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:07.239706 30303 rpcz_store.cc:269] 0807 15:11:05.694470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.694645 (+ 175us) service_pool.cc:227] Handling call
0807 15:11:07.175108 (+1480463us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.240051 884 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.241122 30303 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:07.241575 678 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.241798 30303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1428) took 1544 ms. Trace:
I20260807 15:11:07.237457 29479 rpcz_store.cc:276] 0807 15:11:05.669086 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.669183 (+ 97us) service_pool.cc:227] Handling call
0807 15:11:05.669442 (+ 259us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.169795 (+1500353us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.169824 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.169864 (+ 40us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:07.169891 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.170555 (+ 664us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540009e054. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.170595 (+ 40us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.170815 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3450140544}
I20260807 15:11:07.242151 30303 rpcz_store.cc:276] 0807 15:11:05.697604 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.240587 (+1542983us) service_pool.cc:227] Handling call
0807 15:11:07.240940 (+ 353us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.241539 (+ 599us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.241741 (+ 202us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.242723 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:05.708923 887 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.175774 850 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.243338 29479 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
W20260807 15:11:07.243878 29479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2290) took 1555 ms (client timeout 1894 ms). Trace:
I20260807 15:11:07.243587 887 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:07.244256 29479 rpcz_store.cc:269] 0807 15:11:05.688119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.242454 (+1554335us) service_pool.cc:227] Handling call
0807 15:11:07.243830 (+ 1376us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.243777 30303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1431) took 1545 ms. Trace:
I20260807 15:11:07.245012 850 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.245137 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:06.433470 890 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.182418 826 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.179155 885 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.183491 880 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.168274 30306 raft_consensus.cc:1226] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:07.175616 883 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:07.172158 29487 rpcz_store.cc:269] 0807 15:11:05.679461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.679591 (+ 130us) service_pool.cc:227] Handling call
0807 15:11:07.171618 (+1492027us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.246170 887 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.246088 826 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.166659 860 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.238415 29483 rpcz_store.cc:276] 0807 15:11:05.670703 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.671122 (+ 419us) service_pool.cc:227] Handling call
0807 15:11:05.671338 (+ 216us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.164665 (+1493327us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.164695 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.164749 (+ 54us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:07.164778 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.171860 (+ 7082us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54001833d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.171941 (+ 81us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.172060 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3433995136}
I20260807 15:11:07.248345 30306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1425) took 1552 ms. Trace:
W20260807 15:11:07.180621 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08002fba60 after lost signal to thread 29417
I20260807 15:11:07.248689 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.249167 826 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:07.249547 29483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3044) took 1569 ms (client timeout 1978 ms). Trace:
W20260807 15:11:07.250084 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca8a0 after lost signal to thread 29514
W20260807 15:11:07.250494 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08002de7c0 after lost signal to thread 29515
I20260807 15:11:07.251000 885 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.178650 882 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.164947 794 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:07.165180 877 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.164562 834 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.189041 866 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.186569 864 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.165596 878 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.189855 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.168139 30312 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:07.179244 29480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3034) took 1509 ms. Trace:
I20260807 15:11:07.190579 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.191318 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.192865 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.193008 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.193562 729 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.193737 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:07.169366 29482 rpcz_store.cc:269] 0807 15:11:05.676288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.676401 (+ 113us) service_pool.cc:227] Handling call
0807 15:11:07.168858 (+1492457us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.163424 874 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.170487 29486 rpcz_store.cc:276] 0807 15:11:05.678186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.678300 (+ 114us) service_pool.cc:227] Handling call
0807 15:11:07.170050 (+1491750us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.194510 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.196672 811 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.269426 885 consensus_queue.cc:1046] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260807 15:11:07.248724 30306 rpcz_store.cc:276] 0807 15:11:05.696300 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:06.916173 (+1219873us) service_pool.cc:227] Handling call
0807 15:11:06.916576 (+ 403us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.247469 (+330893us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.248103 (+ 634us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54004317d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.248287 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":578387712}
W20260807 15:11:06.994987 807 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.625s user 0.010s sys 0.023s
I20260807 15:11:07.286634 32626 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Stepping down as leader of term 7
W20260807 15:11:07.286829 807 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.917s user 0.011s sys 0.024s
I20260807 15:11:07.287109 32626 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:07.246037 890 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.288919 864 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.209489 555 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:07.289264 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.289595 555 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.290036 555 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:07.290103 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.290505 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.291396 29638 raft_consensus.cc:2396] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260807 15:11:07.210048 30273 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.983s user 0.018s sys 0.021s
W20260807 15:11:07.292140 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 2.06506e+06us
I20260807 15:11:07.292580 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.292968 30312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1424) took 1597 ms. Trace:
W20260807 15:11:07.293313 29486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2283) took 1607 ms (client timeout 1976 ms). Trace:
I20260807 15:11:07.204053 30310 rpcz_store.cc:276] 0807 15:11:04.276832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:04.276968 (+ 136us) service_pool.cc:227] Handling call
0807 15:11:04.284938 (+ 7970us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:04.297451 (+ 12513us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:04.297482 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:04.297520 (+ 38us) raft_consensus.cc:1631] Marking committed up to 10
0807 15:11:04.297550 (+ 30us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:06.975939 (+2678389us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54006c11d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:06.975990 (+ 51us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:06.976155 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28326656}
I20260807 15:11:07.293548 30312 rpcz_store.cc:276] 0807 15:11:05.696001 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.116600 (+1420599us) service_pool.cc:227] Handling call
0807 15:11:07.116926 (+ 326us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.292086 (+175160us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.292738 (+ 652us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b54006f1654. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.292909 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":117322112}
I20260807 15:11:07.294302 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.294792 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:07.214044 770 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.894s user 0.010s sys 0.024s
I20260807 15:11:07.212119 650 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.296326 729 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.224103 30308 rpcz_store.cc:276] 0807 15:11:05.695583 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.081437 (+1385854us) service_pool.cc:227] Handling call
0807 15:11:07.081777 (+ 340us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.082647 (+ 870us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.082846 (+ 199us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.082896 (+ 50us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:07.082932 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.082992 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.083098 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.112546 547 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.297442 650 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.299232 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.299631 729 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.300374 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.301009 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.301498 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.297434 877 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.302134 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.302510 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.302278 866 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.227492 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.223636 30304 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:11:07.303130 29646 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:07.303791 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.304333 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.230834 520 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.305230 29480 rpcz_store.cc:276] 0807 15:11:05.669883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.715866 (+ 45983us) service_pool.cc:227] Handling call
0807 15:11:07.179185 (+1463319us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.306118 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.306226 520 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.231392 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.162111 768 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:07.213574 822 raft_consensus.cc:2781] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:11:07.269918 814 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.308286 822 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.308431 30272 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:07.308739 822 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:07.308903 29637 raft_consensus.cc:1226] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 8. Current term is 9. Ops: []
W20260807 15:11:07.233068 29608 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.919s user 0.005s sys 0.034s
W20260807 15:11:07.235756 29534 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.976s user 0.018s sys 0.015s
I20260807 15:11:07.308400 883 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:07.145290 30274 connection.cc:232] RPC call timeout handler was delayed by -1.456342336954549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260807 15:11:07.309434 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 2.02763e+06us
W20260807 15:11:07.251798 29511 debug-util.cc:398] Leaking SignalData structure 0x7b080037a280 after lost signal to thread 29594
W20260807 15:11:07.309728 30274 connection.cc:232] RPC call timeout handler was delayed by -1.061145088984631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260807 15:11:07.309934 29511 debug-util.cc:398] Leaking SignalData structure 0x7b0800245d20 after lost signal to thread 29595
W20260807 15:11:07.239408 29532 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.023s user 0.031s sys 0.045s
W20260807 15:11:07.310151 30274 connection.cc:232] RPC call timeout handler was delayed by -1.0481202969676815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260807 15:11:07.311131 29511 debug-util.cc:398] Leaking SignalData structure 0x7b0800087120 after lost signal to thread 29674
W20260807 15:11:07.311451 29511 debug-util.cc:398] Leaking SignalData structure 0x7b08000870e0 after lost signal to thread 29676
W20260807 15:11:06.952379 29453 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.887s user 0.001s sys 0.021s
W20260807 15:11:07.312062 29453 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.247s user 0.002s sys 0.021s
I20260807 15:11:07.313675 855 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.313867 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:07.314550 29566 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:07.314282 855 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.316476 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.317137 29560 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:07.318890 770 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.168082 835 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.319445 770 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.320274 835 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:07.320636 835 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:07.321022 835 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:07.321628 770 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.322183 770 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.322438 855 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.322997 855 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.322717 770 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.323226 884 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.323488 855 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.324434 836 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.325277 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.325479 855 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.205518 886 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.286125 30307 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:07.327169 30307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1426) took 1630 ms. Trace:
I20260807 15:11:07.327493 30307 rpcz_store.cc:276] 0807 15:11:05.696624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.146266 (+1449642us) service_pool.cc:227] Handling call
0807 15:11:07.146678 (+ 412us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.326401 (+179723us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.326955 (+ 554us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54007661d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.327111 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":319994624}
I20260807 15:11:07.329751 29642 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:07.293058 30273 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.330320 29485 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:07.331028 30273 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.331562 878 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:07.249925 29483 rpcz_store.cc:269] 0807 15:11:05.679671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.248457 (+1568786us) service_pool.cc:227] Handling call
0807 15:11:07.249492 (+ 1035us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.332453 29488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3035) took 1662 ms. Trace:
I20260807 15:11:07.333086 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.294921 30310 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 2.
I20260807 15:11:07.212908 30309 rpcz_store.cc:276] 0807 15:11:05.694192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.002686 (+1308494us) service_pool.cc:227] Handling call
0807 15:11:07.003072 (+ 386us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.003282 (+ 210us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.003311 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.003358 (+ 47us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:07.003391 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.003446 (+ 55us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.003591 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.221366 29484 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:07.333760 850 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:11:07.332836 29488 rpcz_store.cc:276] 0807 15:11:05.670131 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.670365 (+ 234us) service_pool.cc:227] Handling call
0807 15:11:05.672127 (+ 1762us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.331457 (+1659330us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.331486 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.331526 (+ 40us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:07.331559 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.332108 (+ 549us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54001d5bd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.332152 (+ 44us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.332280 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3815729536}
I20260807 15:11:07.334347 850 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:07.334697 29484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2285) took 1648 ms (client timeout 1530 ms). Trace:
I20260807 15:11:07.334765 850 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:07.335233 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.211193 29531 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:07.336584 29483 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
W20260807 15:11:07.337218 29483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2284) took 1651 ms (client timeout 2104 ms). Trace:
W20260807 15:11:07.337543 29483 rpcz_store.cc:269] 0807 15:11:05.685831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.332851 (+1647020us) service_pool.cc:227] Handling call
0807 15:11:07.337087 (+ 4236us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:07.336524 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 125423us
I20260807 15:11:07.339916 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.340758 29531 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:07.341570 792 raft_consensus.cc:2781] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:11:07.342099 792 raft_consensus.cc:686] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [term 7 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:07.342221 29531 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:11:07.203608 29481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3045) took 1523 ms (client timeout 1554 ms). Trace:
W20260807 15:11:07.343174 29481 rpcz_store.cc:269] 0807 15:11:05.680702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.202509 (+1521807us) service_pool.cc:227] Handling call
0807 15:11:07.203548 (+ 1039us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.344193 821 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:07.344159 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.344651 821 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.344873 29481 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:07.345037 821 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:07.345402 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2287) took 1658 ms. Trace:
I20260807 15:11:07.345729 29481 rpcz_store.cc:276] 0807 15:11:05.686966 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.343887 (+1656921us) service_pool.cc:227] Handling call
0807 15:11:07.345340 (+ 1453us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.345901 811 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:07.346561 811 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.231974 763 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.347755 29479 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
W20260807 15:11:07.348268 29479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2280) took 1663 ms (client timeout 1960 ms). Trace:
W20260807 15:11:07.348933 29479 rpcz_store.cc:269] 0807 15:11:05.684489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.244906 (+1560417us) service_pool.cc:227] Handling call
0807 15:11:07.348213 (+103307us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.349522 890 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:07.307607 29482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2289) took 1620 ms (client timeout 2036 ms). Trace:
W20260807 15:11:07.350168 29482 rpcz_store.cc:269] 0807 15:11:05.687695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.304107 (+1616412us) service_pool.cc:227] Handling call
0807 15:11:07.307529 (+ 3422us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.350293 763 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:07.150816 29640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59992 (request call id 2521) took 1932 ms (client timeout 2206 ms). Trace:
I20260807 15:11:07.324992 836 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.351128 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.351359 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.352771 836 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:07.335206 29484 rpcz_store.cc:269] 0807 15:11:05.686213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.173986 (+1487773us) service_pool.cc:227] Handling call
0807 15:11:07.334544 (+160558us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b5400320854. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:07.334638 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":106892160}
I20260807 15:11:07.304405 29487 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
W20260807 15:11:07.295490 29486 rpcz_store.cc:269] 0807 15:11:05.685492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.292336 (+1606844us) service_pool.cc:227] Handling call
0807 15:11:07.293239 (+ 903us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.353726 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:07.354084 29487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3050) took 1670 ms (client timeout 2008 ms). Trace:
I20260807 15:11:07.354405 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.354916 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.355563 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.356184 29486 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:07.356262 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.288727 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.333300 859 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:07.357115 859 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.291435 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:07.351078 29640 rpcz_store.cc:269] 0807 15:11:05.218537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:05.218765 (+ 228us) service_pool.cc:227] Handling call
0807 15:11:07.150553 (+1931788us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b540024e5d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:07.150719 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":66064768}
I20260807 15:11:07.357564 859 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:07.357523 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:07.358994 29511 debug-util.cc:398] Leaking SignalData structure 0x7b080039d720 after lost signal to thread 30341
I20260807 15:11:07.359092 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.360172 751 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:07.360368 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.360730 751 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.361534 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:07.331663 29485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2286) took 1645 ms (client timeout 1744 ms). Trace:
W20260807 15:11:07.363076 29485 rpcz_store.cc:269] 0807 15:11:05.686589 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.227208 (+1540619us) service_pool.cc:227] Handling call
0807 15:11:07.331481 (+104273us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b540009ef54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:07.331578 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":62122880}
I20260807 15:11:07.208480 30305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39994 (request call id 1429) took 1510 ms. Trace:
I20260807 15:11:07.302615 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.363739 751 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.352528 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.334759 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.229761 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.364974 29488 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:07.343075 792 consensus_queue.cc:237] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.365352 751 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:07.365833 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:11:07.364976 29483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2282) took 1679 ms (client timeout 2215 ms). Trace:
I20260807 15:11:07.367306 811 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.364081 30305 rpcz_store.cc:276] 0807 15:11:05.697906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.207501 (+1509595us) service_pool.cc:227] Handling call
0807 15:11:07.208406 (+ 905us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.369241 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.369966 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.370374 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.370591 30310 raft_consensus.cc:2379] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 8: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:07.370738 30309 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 8: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:07.370973 29564 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:07.371057 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.371418 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.371724 30306 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:07.329907 886 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.346769 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.368273 883 consensus_queue.cc:1046] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:11:07.373147 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.364229 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:07.354449 29487 rpcz_store.cc:269] 0807 15:11:05.683458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.303541 (+1620083us) service_pool.cc:227] Handling call
0807 15:11:07.354028 (+ 50487us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:07.359412 29511 debug-util.cc:398] Leaking SignalData structure 0x7b0800373de0 after lost signal to thread 30342
W20260807 15:11:07.373867 29483 rpcz_store.cc:269] 0807 15:11:05.685146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.338119 (+1652973us) service_pool.cc:227] Handling call
0807 15:11:07.364916 (+ 26797us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.376561 866 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.376900 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.377039 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.377983 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.378186 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.378559 29483 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:07.379415 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.379766 29640 raft_consensus.cc:2379] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:07.373430 883 raft_consensus.cc:3032] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:07.365876 751 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.380555 883 raft_consensus.cc:729] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:07.380970 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.381189 886 consensus_queue.cc:1046] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 15:11:07.381575 29647 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:07.381412 883 consensus_queue.cc:260] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.374621 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.382722 883 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:07.382953 878 raft_consensus.cc:3032] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:07.383428 878 raft_consensus.cc:729] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:07.384220 878 consensus_queue.cc:260] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.385658 817 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.385943 29452 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:07.386135 836 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.386241 817 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.386698 836 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:07.365547 29488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2288) took 1678 ms (client timeout 2192 ms). Trace:
I20260807 15:11:07.388037 826 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.388605 817 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.388608 826 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.390137 29531 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:07.390883 826 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.391011 817 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:07.391443 817 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:07.388347 29488 rpcz_store.cc:269] 0807 15:11:05.687310 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.334525 (+1647215us) service_pool.cc:227] Handling call
0807 15:11:07.365499 (+ 30974us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.391978 817 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:07.353013 770 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.393380 836 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.391588 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.374671 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:07.373414 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.396224 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.379840 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.398324 751 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.395807 29481 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:07.382799 30312 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:07.373912 30305 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:07.408636 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:07.408872 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.409718 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.410107 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.411046 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.411710 29482 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:07.412868 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.413070 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.414052 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.434103 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:07.401484 859 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:07.402395 29511 debug-util.cc:398] Leaking SignalData structure 0x7b0800273520 after lost signal to thread 760
I20260807 15:11:07.403100 29642 raft_consensus.cc:595] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:07.403334 886 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 15:11:07.403813 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.432418 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.362628 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.405686 866 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:07.407516 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.399456 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.411808 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.307026 555 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.413877 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.414528 29481 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:07.401587 29566 raft_consensus.cc:2396] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260807 15:11:07.398221 850 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.446169 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.445604 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.464948 30310 raft_consensus.cc:2379] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:07.465055 30307 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:07.446491 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.448560 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.456534 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.466873 29570 raft_consensus.cc:1799] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Handling vote request from an unknown peer 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.446774 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.467576 29570 raft_consensus.cc:2396] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260807 15:11:07.449414 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.468959 29483 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:07.444555 29485 raft_consensus.cc:1799] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Handling vote request from an unknown peer 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.470291 29485 raft_consensus.cc:2396] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260807 15:11:07.470882 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:07.400188 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 72420.8us
I20260807 15:11:07.416296 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:07.468065 29533 connection.cc:232] RPC call timeout handler was delayed by -1.1337055049370974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260807 15:11:07.414763 29638 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 10.
I20260807 15:11:07.419284 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.411442 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.474304 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.476173 30311 raft_consensus.cc:1226] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:07.476213 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.476960 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3048) took 1794 ms. Trace:
I20260807 15:11:07.478842 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.478652 29483 rpcz_store.cc:276] 0807 15:11:05.682824 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.476272 (+1793448us) service_pool.cc:227] Handling call
0807 15:11:07.476535 (+ 263us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.476674 (+ 139us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.476704 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.476739 (+ 35us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:07.476767 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.476819 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.476908 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.480659 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2281) took 1795 ms. Trace:
I20260807 15:11:07.481047 29487 rpcz_store.cc:276] 0807 15:11:05.684812 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.479832 (+1795020us) service_pool.cc:227] Handling call
0807 15:11:07.480205 (+ 373us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.480378 (+ 173us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.480400 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.480434 (+ 34us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:07.480471 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.480518 (+ 47us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.480606 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.481420 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 904) took 1759 ms. Trace:
I20260807 15:11:07.477736 29485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2279) took 1793 ms. Trace:
I20260807 15:11:07.482861 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 905) took 1760 ms. Trace:
I20260807 15:11:07.482358 29485 rpcz_store.cc:276] 0807 15:11:05.684147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.477049 (+1792902us) service_pool.cc:227] Handling call
0807 15:11:07.477316 (+ 267us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.477479 (+ 163us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.477504 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.477548 (+ 44us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:07.477587 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.477624 (+ 37us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.477693 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.244899 30303 rpcz_store.cc:276] 0807 15:11:05.698588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.242948 (+1544360us) service_pool.cc:227] Handling call
0807 15:11:07.243260 (+ 312us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.243446 (+ 186us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.243476 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.243526 (+ 50us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:07.243561 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.243615 (+ 54us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.243731 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.429839 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.483353 29487 rpcz_store.cc:276] 0807 15:11:05.722775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.482122 (+1759347us) service_pool.cc:227] Handling call
0807 15:11:07.482401 (+ 279us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.482550 (+ 149us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.482573 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.482609 (+ 36us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:07.482646 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.482711 (+ 65us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.482814 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.432605 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.434404 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.389653 878 raft_consensus.cc:3037] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:07.435802 30272 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:07.488567 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:07.489352 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 53679.1us
I20260807 15:11:07.489277 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.477769 29566 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:11:07.482025 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.490054 29560 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:07.490782 29570 raft_consensus.cc:1226] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:07.419281 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.440220 29642 raft_consensus.cc:603] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 15:11:07.227825 29378 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 374) took 11498 ms (client timeout 15000 ms). Trace:
I20260807 15:11:07.482152 29483 rpcz_store.cc:276] 0807 15:11:05.722463 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.480449 (+1757986us) service_pool.cc:227] Handling call
0807 15:11:07.480709 (+ 260us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.480865 (+ 156us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.480897 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.480934 (+ 37us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:07.480961 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.481030 (+ 69us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.481356 (+ 326us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.493310 29637 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:11:07.447536 866 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:07.470805 807 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 15:11:07.507481 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3051) took 1823 ms. Trace:
I20260807 15:11:07.502727 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3047) took 1820 ms. Trace:
I20260807 15:11:07.508114 29482 rpcz_store.cc:276] 0807 15:11:05.683762 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.483992 (+1800230us) service_pool.cc:227] Handling call
0807 15:11:07.507047 (+ 23055us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.507198 (+ 151us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.507228 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.507264 (+ 36us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:07.507297 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.507341 (+ 44us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.507433 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.508520 29481 rpcz_store.cc:276] 0807 15:11:05.682431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.476986 (+1794555us) service_pool.cc:227] Handling call
0807 15:11:07.502275 (+ 25289us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.502427 (+ 152us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.502455 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.502495 (+ 40us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:07.502527 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.502571 (+ 44us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.502659 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.485328 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 910) took 1069 ms. Trace:
I20260807 15:11:07.494550 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.493117 29449 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:07.496328 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.490321 30272 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:07.445878 886 raft_consensus.cc:3032] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:07.498529 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 907) took 1091 ms. Trace:
I20260807 15:11:07.515542 29487 rpcz_store.cc:276] 0807 15:11:06.407407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.497513 (+1090106us) service_pool.cc:227] Handling call
0807 15:11:07.497871 (+ 358us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.498125 (+ 254us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.498161 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.498225 (+ 64us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:07.498275 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.498342 (+ 67us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.498463 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.516618 30309 raft_consensus.cc:1226] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 2. Current term is 3. Ops: []
I20260807 15:11:07.500094 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 908) took 1085 ms. Trace:
I20260807 15:11:07.288005 32626 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.504213 29484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3049) took 1821 ms. Trace:
I20260807 15:11:07.484472 29485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 906) took 1761 ms. Trace:
I20260807 15:11:07.379873 835 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.510213 29486 rpcz_store.cc:276] 0807 15:11:06.415761 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.356803 (+941042us) service_pool.cc:227] Handling call
0807 15:11:07.485271 (+128468us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.494292 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.513154 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.470652 792 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:07.514241 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 920) took 1094 ms. Trace:
I20260807 15:11:07.527971 29485 rpcz_store.cc:276] 0807 15:11:05.723113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.483739 (+1760626us) service_pool.cc:227] Handling call
0807 15:11:07.484048 (+ 309us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.484212 (+ 164us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.484234 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.484274 (+ 40us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:07.484301 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.484346 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.484425 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.527875 29484 rpcz_store.cc:276] 0807 15:11:05.683145 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.479832 (+1796687us) service_pool.cc:227] Handling call
0807 15:11:07.503437 (+ 23605us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.503626 (+ 189us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.503654 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.503703 (+ 49us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:07.503745 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.503807 (+ 62us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.504138 (+ 331us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.529412 29482 rpcz_store.cc:276] 0807 15:11:06.419415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.509557 (+1090142us) service_pool.cc:227] Handling call
0807 15:11:07.513807 (+ 4250us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.513970 (+ 163us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.513991 (+ 21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.514024 (+ 33us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:11:07.514050 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.514091 (+ 41us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.514192 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:07.445602 29365 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 1177fe2445db43e2b8366f33a841a041 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4b092f7f951b4137b5d7810056684270 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
W20260807 15:11:07.491806 29378 rpcz_store.cc:269] 0807 15:10:55.729356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:55.729551 (+ 195us) service_pool.cc:227] Handling call
0807 15:10:55.948868 (+219317us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400002dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e1d1ed6c 00007f94e1e18c3e 00007f94e012afb4 00007f94e012af42 00007f94e012ae71 00007f94e012adec 00007f94e012a0a2 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.227745 (+11278877us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:11:01.839600 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:11:01.840243 (+ 643us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:11:01.840309 (+ 66us) write_op.cc:435] Acquired schema lock
0807 15:11:01.840321 (+ 12us) tablet.cc:660] Decoding operations
0807 15:11:01.842014 (+ 1693us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:11:01.842121 (+ 107us) write_op.cc:641] Partition lock acquired for write op
0807 15:11:01.842149 (+ 28us) tablet.cc:683] Acquiring locks for 20 operations
0807 15:11:01.896460 (+ 54311us) tablet.cc:699] Row locks acquired
0807 15:11:01.901873 (+ 5413us) write_op.cc:260] PREPARE: finished
0807 15:11:01.917431 (+ 15558us) write_op.cc:270] Start()
0807 15:11:01.936517 (+ 19086us) write_op.cc:276] Timestamp: P: 1786115461911159 usec, L: 0
0807 15:11:01.936549 (+ 32us) op_driver.cc:331] REPLICATION: starting
0807 15:11:01.991581 (+ 55032us) log.cc:842] Serialized 7965 byte log entry
0807 15:11:02.723616 (+732035us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94d8e7e5fe 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e9be22 00007f94dba455bb
0807 15:11:03.347822 (+624206us) op_driver.cc:444] REPLICATION: finished
0807 15:11:03.945338 (+597516us) write_op.cc:301] APPLY: starting
0807 15:11:03.945447 (+ 109us) tablet.cc:1365] starting BulkCheckPresence
0807 15:11:03.945986 (+ 539us) tablet.cc:1368] finished BulkCheckPresence
0807 15:11:03.946018 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:11:03.994581 (+ 48563us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:11:03.995078 (+ 497us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0807 15:11:03.995151 (+ 73us) write_op.cc:312] APPLY: finished
0807 15:11:03.996051 (+ 900us) log.cc:842] Serialized 139 byte log entry
0807 15:11:03.997287 (+ 1236us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:03.997568 (+ 281us) write_op.cc:454] Released schema lock
0807 15:11:03.997648 (+ 80us) write_op.cc:341] FINISH: Updating metrics
0807 15:11:03.998085 (+ 437us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:03.998122 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":34,"spinlock_wait_cycles":337212288,"child_traces":[["op",{"apply.queue_time_us":597121,"apply.run_cpu_time_us":6550,"apply.run_wall_time_us":53379,"num_ops":20,"prepare.queue_time_us":257421,"prepare.run_cpu_time_us":56714,"prepare.run_wall_time_us":1019534,"raft.queue_time_us":289148,"raft.run_cpu_time_us":23797,"raft.run_wall_time_us":421131,"replication_time_us":1401820,"spinlock_wait_cycles":8038144,"thread_start_us":1516524,"threads_started":4,"wal-append.queue_time_us":849828,"wal-append.run_cpu_time_us":61007,"wal-append.run_wall_time_us":2162712}]]}
I20260807 15:11:07.517423 29483 rpcz_store.cc:276] 0807 15:11:06.414896 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.498985 (+1084089us) service_pool.cc:227] Handling call
0807 15:11:07.499359 (+ 374us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.499559 (+ 200us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:07.499593 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:07.499644 (+ 51us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:07.499686 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.499747 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:07.499859 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:07.507081 864 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:07.511279 866 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:07.454555 794 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.515473 886 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:11:07.564213 29365 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 118675us
I20260807 15:11:07.566104 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:07.533595 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 215199us
W20260807 15:11:07.568253 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 53922.2us
I20260807 15:11:07.542423 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.527679 817 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.597484 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.599300 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.527223 811 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 15:11:07.516919 887 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:11:07.611827 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.617221 30308 raft_consensus.cc:1226] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:07.620505 30311 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:07.565404 864 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:07.632808 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.634433 555 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.634704 814 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.637301 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.637593 29561 raft_consensus.cc:1226] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:07.637305 817 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.640359 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.651146 30308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1432) took 1230 ms. Trace:
I20260807 15:11:07.651767 30308 rpcz_store.cc:276] 0807 15:11:06.420980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.297837 (+876857us) service_pool.cc:227] Handling call
0807 15:11:07.298129 (+ 292us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:07.621757 (+323628us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:07.650829 (+ 29072us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b5400765054. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:07.651062 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":733346560}
I20260807 15:11:07.654050 32626 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:07.619848 811 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:07.655927 811 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:07.656352 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.658975 882 consensus_queue.cc:1046] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:07.661856 882 raft_consensus.cc:3032] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:07.662358 882 raft_consensus.cc:729] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:07.662612 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.659461 794 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:07.665325 903 log.cc:924] Time spent T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
I20260807 15:11:07.666368 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.666621 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.669255 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:07.671000 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.672637 850 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.672587 811 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.640165 821 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:07.676431 811 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.678134 821 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.685046 835 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.685390 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.686990 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.689172 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.629689 864 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:07.693389 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.663436 882 consensus_queue.cc:260] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.695492 882 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:07.559281 792 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.695729 29479 raft_consensus.cc:2454] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:07.697613 792 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.698177 29570 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:11:07.629987 822 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.673642 859 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.707242 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.708580 822 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:07.712160 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.674582 30274 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:07.702682 29564 raft_consensus.cc:1226] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:07.704502 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.704936 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:07.705165 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:07.705720 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 66037us
I20260807 15:11:07.715171 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.717604 29645 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Advancing to term 11
W20260807 15:11:07.724340 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 49869.7us
I20260807 15:11:07.725265 30274 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:07.726580 30274 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:07.743870 29642 raft_consensus.cc:1226] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 2. Current term is 3. Ops: []
I20260807 15:11:07.737530 859 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 15:11:07.792223 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.793756 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.733371 751 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 15:11:07.813467 29608 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:07.815019 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.816628 547 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:07.817109 547 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.817492 547 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:07.819156 30274 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:07.821417 859 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:07.823091 29480 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:07.753243 835 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260807 15:11:07.824172 29480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3046) took 2142 ms (client timeout 2105 ms). Trace:
I20260807 15:11:07.713702 890 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
W20260807 15:11:07.826858 29480 rpcz_store.cc:269] 0807 15:11:05.682076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:07.305888 (+1623812us) service_pool.cc:227] Handling call
0807 15:11:07.824013 (+518125us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400182ed4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:07.824107 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1187580160}
I20260807 15:11:07.830899 30274 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:07.832059 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 233242us
I20260807 15:11:07.832985 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.835758 30274 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:07.840605 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.840860 29645 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 11.
I20260807 15:11:07.841635 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.842414 29564 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:07.844229 30272 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:07.826787 835 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:07.848897 29608 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:07.853459 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.836381 678 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:11:07.856563 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.858511 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.846156 859 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:07.847311 835 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:07.853997 780 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:07.856545 834 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader election won for term 11
I20260807 15:11:07.843721 889 consensus_queue.cc:1046] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260807 15:11:07.874274 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.874971 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:07.871358 834 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 11 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:07.880744 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.882030 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.884722 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:07.886562 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.888614 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:07.879022 822 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:07.890439 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.891701 30311 raft_consensus.cc:2379] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 9: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:07.893430 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.888036 834 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.898727 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.899278 30308 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:07.901089 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.906453 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.907105 29564 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:11:07.906994 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.908946 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.881156 866 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.909852 30311 raft_consensus.cc:2379] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 8: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:07.892686 822 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:07.911674 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:07.912499 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:07.917131 30308 raft_consensus.cc:2379] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:07.918236 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:07.902666 864 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.920138 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.923105 29481 raft_consensus.cc:1226] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:07.923624 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.924324 29570 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:11:07.916675 822 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:07.931107 884 raft_consensus.cc:3032] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:11:07.932775 886 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:07.934552 886 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:07.936367 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.937608 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.938457 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.938591 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.938764 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.939610 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.940224 29567 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:11:07.940721 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.946707 864 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:07.952387 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:07.953262 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.931721 884 raft_consensus.cc:729] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:07.955205 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.957083 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:07.960758 29482 raft_consensus.cc:2454] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
I20260807 15:11:07.966877 29533 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.976717 29533 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.978359 29533 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:07.956809 821 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:07.981406 29533 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.985121 29533 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:08.002246 29533 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.974896 855 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 15:11:08.016583 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 180893us
I20260807 15:11:08.017730 30274 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:08.019421 30274 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:08.021150 30274 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:07.982203 770 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:08.022832 30274 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:07.982430 555 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:07.984092 817 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:07.984267 821 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.007157 792 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:08.026577 29488 raft_consensus.cc:2454] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:08.008889 836 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:08.046285 763 raft_consensus.cc:2781] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:08.025172 751 raft_consensus.cc:2781] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
W20260807 15:11:08.071395 912 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.096s user 0.001s sys 0.000s
I20260807 15:11:08.023437 807 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:08.072309 807 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.054996 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:08.027127 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:08.036635 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:08.050585 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 194619us
I20260807 15:11:08.051630 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:08.074687 29484 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:08.052291 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:08.020138 855 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.022267 678 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:08.061470 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:07.981762 547 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.025854 770 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:08.046566 911 log.cc:924] Time spent T 00000000000000000000000000000000 P ce1e7c41f736452080b21dd983c40ba5: Append to log took a long time: real 0.061s user 0.000s sys 0.001s
I20260807 15:11:08.081122 29485 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:08.048942 555 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.052398 821 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:08.082335 29481 raft_consensus.cc:2362] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4. Re-sending same reply.
I20260807 15:11:08.083467 751 raft_consensus.cc:686] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:08.112150 751 consensus_queue.cc:237] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.095530 547 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:08.105645 866 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:08.110174 555 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:08.054524 29609 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.117539 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:08.118235 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 68287.3us
I20260807 15:11:08.118975 29609 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:08.029598 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:08.084050 855 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.096076 29645 raft_consensus.cc:1226] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:08.119124 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:08.120620 29564 raft_consensus.cc:2396] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260807 15:11:08.016209 884 consensus_queue.cc:260] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.117561 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.125087 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:08.125412 884 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:08.086477 770 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.075664 763 raft_consensus.cc:686] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [term 6 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:08.130085 763 consensus_queue.cc:237] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.136004 29609 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.140228 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.152737 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:08.045006 913 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:11:08.162624 30274 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:08.163636 834 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:08.164230 834 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:11:08.164319 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 162152us
I20260807 15:11:08.160406 29566 raft_consensus.cc:2379] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:08.111188 835 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.164774 834 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:08.072712 807 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:08.168921 30305 raft_consensus.cc:2379] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 9: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:08.169188 30274 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:08.171231 794 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:08.171021 29533 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:08.174853 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.175719 29564 raft_consensus.cc:2379] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:08.177451 30274 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:08.178557 29609 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.160388 815 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:08.182225 815 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:08.182611 815 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.151921 405 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:08.054416 792 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.186735 835 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:08.190564 792 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:08.188889 780 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:08.196118 918 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:08.196590 918 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.196952 918 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.191030 866 consensus_queue.cc:1046] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260807 15:11:08.201386 866 raft_consensus.cc:3032] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:08.201629 29609 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.200146 796 consensus_queue.cc:1046] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:11:08.201807 866 raft_consensus.cc:729] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:08.205507 29533 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:08.211144 29533 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:08.214272 29533 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:08.188676 794 raft_consensus.cc:2781] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 15:11:08.236299 30274 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:08.247368 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:08.247989 859 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:08.248435 29481 raft_consensus.cc:2379] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 9: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:08.249195 794 raft_consensus.cc:686] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:08.250104 770 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.220700 836 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:08.220762 547 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:08.221065 817 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:08.190804 910 consensus_queue.cc:1046] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260807 15:11:08.220890 914 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:11:08.256541 836 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.301048 770 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.292735 822 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.303459 555 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.305610 822 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:08.305827 555 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.306622 931 raft_consensus.cc:3032] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:08.307085 931 raft_consensus.cc:729] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.250411 794 consensus_queue.cc:237] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.307982 931 consensus_queue.cc:260] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.309333 931 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:11:08.292055 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 87812.8us
I20260807 15:11:08.311110 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:08.300810 855 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.317776 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 103646us
I20260807 15:11:08.318735 29533 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:08.320235 29533 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:08.319814 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:08.322418 29533 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:08.320633 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:08.324239 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:08.324855 30311 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 8: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:08.320273 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:08.284528 817 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:08.326125 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:08.332386 29567 raft_consensus.cc:1226] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:08.311620 836 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.324311 555 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:08.329071 817 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.331241 927 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:08.348491 817 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:08.348580 555 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:08.349119 555 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.349210 855 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.349572 555 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:08.353650 29480 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:08.353495 807 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.327040 770 raft_consensus.cc:2726] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:08.330617 928 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:08.356876 928 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:08.357264 928 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:08.284356 866 consensus_queue.cc:260] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.358306 866 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.358107 555 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:08.360364 555 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:11:08.364221 918 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.366649 918 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.368396 821 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.364233 29563 raft_consensus.cc:1226] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:08.364646 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:08.377079 792 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.379815 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 56168.6us
I20260807 15:11:08.381268 29609 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.382073 928 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.382550 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.384101 926 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:08.384765 547 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:08.385888 29609 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.386680 547 raft_consensus.cc:3037] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:08.388525 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:08.348630 927 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:08.390053 927 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:08.379276 29565 raft_consensus.cc:1226] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:08.392205 928 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:08.392544 29609 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.411821 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.418963 29485 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:08.403645 821 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.426070 29646 raft_consensus.cc:1226] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:08.397660 380 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 15:11:08.422312 910 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:08.452459 29646 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260807 15:11:08.457647 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:08.447216 910 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:08.444067 884 consensus_queue.cc:1046] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260807 15:11:08.428701 815 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.477797 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:08.480121 926 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:08.480754 926 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.481714 926 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.484287 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:08.487305 884 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:08.487824 884 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:08.488801 884 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.490461 884 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:08.490738 815 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:08.492416 547 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:08.495497 29481 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:08.500908 807 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.446762 834 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.473651 910 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:08.510680 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:08.515115 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.529986 30305 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:08.528663 29642 raft_consensus.cc:1226] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:08.523125 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.523764 29645 pending_rounds.cc:76] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Aborting all ops after (but not including) 5
I20260807 15:11:08.530921 29645 pending_rounds.cc:97] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260807 15:11:08.531287 29645 raft_consensus.cc:2866] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:11:08.526162 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.526530 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.528573 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.529376 29638 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 15:11:08.513809 927 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.534269 29432 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 9bbe5c211ab64989a57350f34f007ced is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } }
I20260807 15:11:08.528710 792 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.535019 822 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:08.550366 927 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.552621 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.553727 834 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.554524 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.555320 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:08.555495 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.556950 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.560138 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.556017 29487 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:08.560798 29565 raft_consensus.cc:1226] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:08.562114 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.563130 29638 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:08.564306 913 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:08.564363 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.564989 913 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.567186 913 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.565277 29609 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:08.569630 914 raft_consensus.cc:3032] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:11:08.570125 914 raft_consensus.cc:729] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.570216 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:08.559990 29563 raft_consensus.cc:1226] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:08.563694 29567 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:08.563695 29638 raft_consensus.cc:595] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:08.572121 29638 raft_consensus.cc:603] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:11:08.560078 29564 raft_consensus.cc:1226] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:08.572916 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:08.575218 29565 raft_consensus.cc:1226] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:08.576799 29608 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.469036 794 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
W20260807 15:11:08.585479 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet e6a9409698ac457faa20f77f1cf661a7, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.593708 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet e6a9409698ac457faa20f77f1cf661a7, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.596722 29608 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.597935 796 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260807 15:11:08.598405 29608 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.598709 792 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:08.599196 29564 raft_consensus.cc:1226] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:08.600006 928 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:08.600734 928 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:08.584673 405 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:11:08.607363 405 raft_consensus.cc:686] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.608531 405 consensus_queue.cc:237] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.584270 834 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:08.609786 834 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.599691 29608 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.613430 822 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:08.613884 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:08.613246 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 995314457256466c935b10a561d7003e, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.614766 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 995314457256466c935b10a561d7003e, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.621309 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 295251us
I20260807 15:11:08.623813 29487 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:08.624137 29481 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 15:11:08.626384 29608 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:08.612150 927 consensus_queue.cc:1046] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260807 15:11:08.626333 834 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:11:08.635667 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet b45f04f91dc84b71b311beec0d34d756, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.636093 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet b45f04f91dc84b71b311beec0d34d756, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.636951 836 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.637616 29382 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 367) took 10419 ms. Trace:
I20260807 15:11:08.628413 914 consensus_queue.cc:260] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.638716 914 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:08.639355 836 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.632054 821 consensus_queue.cc:1046] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260807 15:11:08.628772 929 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.640054 807 raft_consensus.cc:3032] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:08.640604 821 raft_consensus.cc:3032] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:08.640379 913 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:08.640758 807 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:08.641103 821 raft_consensus.cc:729] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:08.641827 807 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.642025 821 consensus_queue.cc:260] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.643231 807 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.643312 821 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:08.643733 29480 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260807 15:11:08.649086 822 consensus_queue.cc:1159] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "00dd11bf8fd9487580aba733c2996a4a" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260807 15:11:08.649413 29640 raft_consensus.cc:1261] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 15:11:08.650367 860 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:08.652007 860 consensus_queue.cc:1035] T f23cf6497a87482cb9bd824261ba383f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:11:08.640033 910 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.655866 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:11:08.656510 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 27275fe691bf4c42814ccca06801b625, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.656873 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 27275fe691bf4c42814ccca06801b625, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.661638 767 consensus_queue.cc:1046] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:08.663296 780 raft_consensus.cc:3032] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:08.663729 780 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.664726 780 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.658975 29378 catalog_manager.cc:5495] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 7 to 8, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 8 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:08.672055 29487 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:08.674559 29378 catalog_manager.cc:5495] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 5, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 5 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:08.666460 780 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:08.707798 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.697714 917 consensus_queue.cc:1046] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260807 15:11:08.726270 917 raft_consensus.cc:3032] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:08.726419 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.726893 917 raft_consensus.cc:729] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.728484 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.726292 29378 catalog_manager.cc:5495] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:08.730465 29485 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260807 15:11:08.732210 920 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 15:11:08.732079 29378 catalog_manager.cc:5495] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:08.734297 29378 catalog_manager.cc:5495] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 5 to 8, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 8 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:08.698823 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.725090 29566 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 10.
I20260807 15:11:08.689358 29640 raft_consensus.cc:3037] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:08.686352 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:08.738245 30305 raft_consensus.cc:2379] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 8: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:08.704321 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.751411 29378 catalog_manager.cc:5495] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:08.706172 860 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:08.687018 910 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:08.754171 29378 catalog_manager.cc:5495] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:08.684383 935 consensus_queue.cc:1046] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260807 15:11:08.638059 29382 rpcz_store.cc:276] 0807 15:10:58.218654 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:10:58.218926 (+ 272us) service_pool.cc:227] Handling call
0807 15:11:08.637547 (+10418621us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:11:07.660079 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:11:07.660613 (+ 534us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:11:07.660649 (+ 36us) write_op.cc:435] Acquired schema lock
0807 15:11:07.660659 (+ 10us) tablet.cc:660] Decoding operations
0807 15:11:07.660978 (+ 319us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:11:07.661033 (+ 55us) write_op.cc:641] Partition lock acquired for write op
0807 15:11:07.661056 (+ 23us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:11:07.661254 (+ 198us) tablet.cc:699] Row locks acquired
0807 15:11:07.661268 (+ 14us) write_op.cc:260] PREPARE: finished
0807 15:11:07.661422 (+ 154us) write_op.cc:270] Start()
0807 15:11:07.661529 (+ 107us) write_op.cc:276] Timestamp: P: 1786115467661377 usec, L: 0
0807 15:11:07.661547 (+ 18us) op_driver.cc:331] REPLICATION: starting
0807 15:11:07.662170 (+ 623us) log.cc:842] Serialized 539 byte log entry
0807 15:11:08.293170 (+631000us) op_driver.cc:444] REPLICATION: finished
0807 15:11:08.405814 (+112644us) write_op.cc:301] APPLY: starting
0807 15:11:08.405897 (+ 83us) tablet.cc:1365] starting BulkCheckPresence
0807 15:11:08.405993 (+ 96us) tablet.cc:1368] finished BulkCheckPresence
0807 15:11:08.406107 (+ 114us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:11:08.406356 (+ 249us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:11:08.406574 (+ 218us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 15:11:08.406616 (+ 42us) write_op.cc:312] APPLY: finished
0807 15:11:08.406838 (+ 222us) log.cc:842] Serialized 23 byte log entry
0807 15:11:08.407007 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:08.407093 (+ 86us) write_op.cc:454] Released schema lock
0807 15:11:08.407129 (+ 36us) write_op.cc:341] FINISH: Updating metrics
0807 15:11:08.407429 (+ 300us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:08.407454 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1657331,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":112359,"apply.run_cpu_time_us":1864,"apply.run_wall_time_us":1865,"num_ops":1,"prepare.queue_time_us":211514,"prepare.run_cpu_time_us":36616,"prepare.run_wall_time_us":190725,"raft.queue_time_us":127797,"raft.run_cpu_time_us":22836,"raft.run_wall_time_us":117737,"replication_time_us":631519,"thread_start_us":456679,"threads_started":4,"wal-append.queue_time_us":320755}]]}
I20260807 15:11:08.763422 29378 catalog_manager.cc:5495] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:08.683722 926 consensus_queue.cc:1046] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260807 15:11:08.698378 814 consensus_queue.cc:1046] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260807 15:11:08.747062 917 consensus_queue.cc:260] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.690604 817 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.696657 815 consensus_queue.cc:1046] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260807 15:11:08.698004 796 consensus_queue.cc:1046] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260807 15:11:08.775158 926 raft_consensus.cc:3032] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:08.775286 796 raft_consensus.cc:3032] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:08.775651 926 raft_consensus.cc:729] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.763455 860 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:08.776804 926 consensus_queue.cc:260] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:08.770632 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 74199.1us
I20260807 15:11:08.771570 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.779356 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:08.781888 29608 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:08.782433 29640 raft_consensus.cc:1261] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:08.777761 817 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:08.778005 860 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:08.775743 796 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.788962 917 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.789613 796 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.791683 815 raft_consensus.cc:3032] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:08.792156 815 raft_consensus.cc:729] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.793001 815 consensus_queue.cc:260] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:08.794016 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:08.795261 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:08.796245 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:08.797013 815 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:08.797405 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:08.797967 29568 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:08.800751 796 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:08.800807 678 consensus_queue.cc:1035] T 41559fba51e74c12a634f00bc225cd7b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:08.804613 910 raft_consensus.cc:3032] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:08.805022 910 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:08.805852 910 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:08.835220 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:08.806200 822 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:08.818116 29564 raft_consensus.cc:2396] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260807 15:11:08.817806 934 consensus_queue.cc:1046] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:11:08.819919 926 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:08.820744 929 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:11:08.893814 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 51063us
I20260807 15:11:08.822212 935 raft_consensus.cc:3032] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:08.817008 943 consensus_queue.cc:1046] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260807 15:11:08.834304 29561 raft_consensus.cc:1226] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:08.801129 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.054468 29565 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:11:08.837532 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:08.892488 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:09.040449 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:09.040866 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:08.978055 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:09.004640 940 log.cc:924] Time spent T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
W20260807 15:11:09.004815 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 176408us
I20260807 15:11:08.977452 29640 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
W20260807 15:11:08.851416 945 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
I20260807 15:11:09.047266 29568 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 11.
I20260807 15:11:09.063321 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:09.065258 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.081632 29570 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260807 15:11:09.104795 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.110121 943 raft_consensus.cc:3032] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:09.111433 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:09.112110 29569 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:11:09.051367 935 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:09.140282 29487 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260807 15:11:09.142102 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.144342 935 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:09.145933 935 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:09.149237 29533 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:09.150162 937 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:09.150545 937 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:09.150684 29533 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:09.150905 937 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:09.152599 817 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:11:09.153023 817 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:09.153410 817 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:09.127095 910 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:09.158721 937 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:09.118963 943 raft_consensus.cc:729] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:09.160899 943 consensus_queue.cc:260] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:09.162863 943 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:09.172113 937 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:09.184999 928 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:09.191303 29561 raft_consensus.cc:1226] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:09.191972 29569 raft_consensus.cc:1261] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 15:11:09.194352 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:09.196940 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 69255.8us
I20260807 15:11:09.221172 29642 raft_consensus.cc:1226] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
W20260807 15:11:09.226195 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 110977us
I20260807 15:11:09.229065 884 consensus_queue.cc:1046] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:11:09.230415 884 raft_consensus.cc:3032] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:09.230827 884 raft_consensus.cc:729] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:09.236451 29642 raft_consensus.cc:1261] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260807 15:11:09.244567 884 consensus_queue.cc:260] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:09.246552 884 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:11:09.249846 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 209265us
I20260807 15:11:09.251700 960 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:09.252250 960 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:09.254498 960 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:09.219967 931 consensus_queue.cc:1046] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260807 15:11:09.227214 928 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:11:09.277585 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 52023.5us
I20260807 15:11:09.285553 30305 raft_consensus.cc:1261] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260807 15:11:09.294983 29640 raft_consensus.cc:595] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:09.296074 920 consensus_queue.cc:1035] T e1b28d0b706f4cacbfda48dd13e4d700 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 15:11:09.300228 29561 raft_consensus.cc:1226] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:09.300807 914 consensus_queue.cc:1046] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260807 15:11:09.307833 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 97564.9us
I20260807 15:11:09.308521 29640 raft_consensus.cc:603] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:11:09.243525 405 consensus_queue.cc:1035] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260807 15:11:09.275439 932 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260807 15:11:09.362126 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:09.366120 817 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:09.345534 931 raft_consensus.cc:3032] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:09.370162 29487 raft_consensus.cc:1261] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 15:11:09.370738 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 218966us
I20260807 15:11:09.371411 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:09.335667 380 raft_consensus.cc:3032] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:09.375242 814 consensus_queue.cc:1035] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260807 15:11:09.373757 796 consensus_queue.cc:1035] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260807 15:11:09.375590 380 raft_consensus.cc:729] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:09.393695 380 consensus_queue.cc:260] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:09.388368 807 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:09.395583 380 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:09.368767 931 raft_consensus.cc:729] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:09.410914 931 consensus_queue.cc:260] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:09.412884 931 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:11:09.424296 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 54265.6us
W20260807 15:11:09.426880 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 122606us
W20260807 15:11:09.430248 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 96284.4us
I20260807 15:11:09.434625 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:09.405817 29533 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:09.442898 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:09.443827 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:09.444486 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.445221 29481 raft_consensus.cc:2354] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 8. Current term is 9.
I20260807 15:11:09.445793 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:09.442898 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:09.448575 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:09.449514 30311 raft_consensus.cc:1226] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:09.451241 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:09.451267 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:09.451440 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:09.453838 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:09.455129 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:09.457959 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.458736 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.465698 30306 raft_consensus.cc:3037] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:09.441093 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:09.513391 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:09.513957 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:11:09.514714 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 57991.3us
I20260807 15:11:09.520617 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.522166 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.523515 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.524638 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.525341 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:09.526988 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.528405 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.530121 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:09.530297 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.531025 30305 raft_consensus.cc:1226] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260807 15:11:09.531267 29561 raft_consensus.cc:2396] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260807 15:11:09.531804 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.533361 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.533644 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.534439 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.534291 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.534868 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.536571 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.372291 928 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:09.537381 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.538542 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:09.548420 29570 raft_consensus.cc:2379] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:11:09.549258 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 178218us
I20260807 15:11:09.541113 29487 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:09.540230 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:09.540608 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:09.553993 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.554458 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.555154 29569 raft_consensus.cc:2379] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:09.556865 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.556334 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.559564 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.571581 30306 raft_consensus.cc:1261] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 15:11:09.512583 807 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:09.550447 29450 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:09.576964 29450 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
W20260807 15:11:09.621694 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 92364.7us
I20260807 15:11:09.536137 817 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:09.646384 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.524613 884 consensus_queue.cc:1046] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260807 15:11:09.524454 968 consensus_queue.cc:1046] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260807 15:11:09.645761 29642 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e0c073edf1454d1589526a840754b5da"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:09.645228 957 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:09.689952 29642 raft_consensus.cc:595] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:09.644680 975 raft_consensus.cc:2781] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:11:09.694097 29486 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:09.696201 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:09.700407 29561 raft_consensus.cc:2379] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:09.722770 29637 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:11:09.689417 884 raft_consensus.cc:3032] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:09.646174 547 raft_consensus.cc:3032] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:09.706996 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:09.687835 887 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:09.792244 943 consensus_meta.cc:287] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.629s user 0.023s sys 0.000s
I20260807 15:11:09.792593 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.793499 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.809572 29561 raft_consensus.cc:2379] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:09.699977 860 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:09.700939 957 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:09.702369 975 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:09.814407 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 237499us
W20260807 15:11:09.824199 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 356906us
I20260807 15:11:09.847319 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:09.757117 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 152400us
I20260807 15:11:09.866108 29570 raft_consensus.cc:2379] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:09.793030 547 raft_consensus.cc:729] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:09.759322 884 raft_consensus.cc:729] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:09.792742 807 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:09.924887 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:09.858237 953 log.cc:924] Time spent T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.103s user 0.000s sys 0.000s
W20260807 15:11:09.858407 977 log.cc:924] Time spent T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.100s user 0.001s sys 0.000s
I20260807 15:11:09.844429 957 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:09.935503 29570 raft_consensus.cc:2379] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 8: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:09.859874 975 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:09.928300 982 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:09.815269 887 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:09.984614 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.988319 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:09.992400 29561 raft_consensus.cc:2379] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:09.846477 860 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.005836 29568 raft_consensus.cc:2379] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:09.931218 932 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:10.039287 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.055984 884 consensus_queue.cc:260] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:10.058300 884 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:11:10.068912 380 consensus_meta.cc:287] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.637s user 0.011s sys 0.000s
I20260807 15:11:09.939596 807 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.130236 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:10.132402 807 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:09.994020 547 consensus_queue.cc:260] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:10.076138 821 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:10.133924 821 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:10.136658 821 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:10.079041 931 consensus_meta.cc:287] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.666s user 0.011s sys 0.001s
I20260807 15:11:10.033910 934 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:10.138144 949 log.cc:924] Time spent T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.867s user 0.019s sys 0.009s
I20260807 15:11:10.138623 934 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:10.141187 934 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:10.142186 29638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35570 (request call id 797) took 1322 ms. Trace:
I20260807 15:11:10.142666 29638 rpcz_store.cc:276] 0807 15:11:08.820009 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:08.820143 (+ 134us) service_pool.cc:227] Handling call
0807 15:11:08.820606 (+ 463us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:08.821116 (+ 510us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:08.821150 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:08.821618 (+ 468us) log.cc:842] Serialized 26 byte log entry
0807 15:11:09.005409 (+183791us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:09.005448 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:09.005517 (+ 69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:10.137732 (+1132215us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b24001f3ec8. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8cf4cf4 00007f94d8cf2dfb 00007f94d8d81559 00007f94d8d811e5 00007f94d8d8082d 00007f94dba2f46e 00007f94dba46c0c 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551
0807 15:11:10.141775 (+ 4043us) raft_consensus.cc:1671] finished
0807 15:11:10.141805 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:10.142083 (+ 278us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1194,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":4518784,"thread_start_us":183360,"threads_started":1,"wal-append.queue_time_us":380487}
I20260807 15:11:09.976332 917 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:10.081385 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.082199 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.145231 29561 raft_consensus.cc:2379] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 6: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:10.144958 917 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:10.083362 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.083525 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.086994 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.146538 29564 raft_consensus.cc:2379] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:10.088128 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.147162 917 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:10.147886 29563 raft_consensus.cc:2396] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260807 15:11:10.155078 944 raft_consensus.cc:3032] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:10.160744 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:10.170297 30274 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.728s user 0.002s sys 0.000s
W20260807 15:11:10.170243 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 297566us
W20260807 15:11:10.174669 30274 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.733s user 0.002s sys 0.001s
W20260807 15:11:10.175169 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 733485us
W20260807 15:11:10.173789 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 350629us
I20260807 15:11:10.177879 976 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:10.178440 976 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.180635 976 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:10.181699 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.182477 29638 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
W20260807 15:11:10.172612 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 377107us
I20260807 15:11:10.185499 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:10.186245 30310 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 2.
I20260807 15:11:10.187569 958 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:10.190608 1000 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:10.191150 1000 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.193332 1000 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.193775 986 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:10.194370 986 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.199517 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.200116 986 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.212345 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.212949 29449 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:10.213375 29479 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:10.188174 958 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.218740 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.097041 887 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.014205 982 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.103466 860 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:10.109038 932 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.252476 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.253168 29641 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:10.253206 796 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:10.254104 932 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.254806 30305 raft_consensus.cc:1226] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:10.219528 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.255839 29566 raft_consensus.cc:2362] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5. Re-sending same reply.
I20260807 15:11:10.082535 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.219878 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.256724 29564 raft_consensus.cc:2362] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 11. Re-sending same reply.
I20260807 15:11:10.257002 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:10.257781 30308 raft_consensus.cc:2379] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 6: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:10.220286 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.221230 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:10.258487 30306 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:11:10.256739 29569 raft_consensus.cc:2379] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:10.228545 29531 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:10.230119 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.230599 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.220005 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.259792 29486 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:10.238540 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.260502 29567 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
W20260807 15:11:10.172303 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 313505us
I20260807 15:11:10.239355 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.247694 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.243221 29570 raft_consensus.cc:1226] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:10.261508 29560 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:10.250432 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.253809 796 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:10.155725 944 raft_consensus.cc:729] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:10.255323 982 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:10.265251 29609 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:10.228451 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:10.261536 29644 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
I20260807 15:11:10.252058 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.266243 29561 raft_consensus.cc:2379] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 3: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:10.262944 29450 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:10.269114 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.231389 984 raft_consensus.cc:2781] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:10.269905 984 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:10.270267 984 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:10.272315 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.266587 29488 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
W20260807 15:11:10.276427 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 47974.2us
I20260807 15:11:10.276597 980 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:11:10.277262 980 raft_consensus.cc:686] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:10.269927 29644 raft_consensus.cc:2379] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 9: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:10.277789 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:10.277567 29380 catalog_manager.cc:5495] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 4, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 4 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:10.282187 931 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:10.282811 931 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:10.283208 931 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:10.284386 975 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.285143 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.286818 975 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.231806 926 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:10.288022 926 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:10.289608 991 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:10.290046 926 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:10.291023 796 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:10.296607 30274 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.278541 30312 raft_consensus.cc:2379] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 3: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:10.278209 980 consensus_queue.cc:237] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.305445 29608 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:10.307574 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.308205 29565 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:10.308283 30273 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.291069 29450 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:10.282248 380 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:10.299541 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:10.310138 29531 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:10.311273 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.312724 29452 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:10.313244 29450 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.316879 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.317050 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.317543 29565 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:10.298607 963 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:10.302110 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:10.301915 29380 catalog_manager.cc:5495] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 4 to 5, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 5 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:11:10.303256 547 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:10.304040 767 raft_consensus.cc:979] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:10.320500 29483 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 15:11:10.321650 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.317586 29480 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:10.331135 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:10.332051 29565 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:10.299842 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 375) took 2154 ms. Trace:
I20260807 15:11:10.323084 29450 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.323532 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:10.323020 29380 catalog_manager.cc:5495] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 3 to 5, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 5 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 15:11:10.323910 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.326867 991 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:10.330348 973 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:10.335115 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:10.291069 958 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.339673 29450 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.340107 29380 catalog_manager.cc:5495] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 4 to 5, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to 9bbe5c211ab64989a57350f34f007ced (127.27.144.193). New cstate: current_term: 5 leader_uuid: "9bbe5c211ab64989a57350f34f007ced" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:10.346855 935 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:10.346985 30273 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.347476 935 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.348084 1008 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:10.330470 969 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:10.348973 969 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:10.349351 969 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:10.349650 935 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.321156 917 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:10.341090 29561 raft_consensus.cc:1226] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:10.341775 29482 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:10.341722 29609 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:10.341846 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.328431 963 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:10.371479 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:10.332878 807 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:10.334055 975 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:10.370447 29644 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:10.380290 29450 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.401005 29644 raft_consensus.cc:595] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:10.401489 29644 raft_consensus.cc:603] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:11:10.401737 29450 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.354597 30273 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:10.370927 29608 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:10.380070 29533 leader_election.cc:398] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 8. Current term is 9.
I20260807 15:11:10.403069 29450 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:10.332929 29378 rpcz_store.cc:276] 0807 15:11:08.093583 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:08.096168 (+ 2585us) service_pool.cc:227] Handling call
0807 15:11:10.247429 (+2151261us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:11:09.243829 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:11:09.282230 (+ 38401us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:11:09.282277 (+ 47us) write_op.cc:435] Acquired schema lock
0807 15:11:09.282291 (+ 14us) tablet.cc:660] Decoding operations
0807 15:11:09.283164 (+ 873us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:11:09.283226 (+ 62us) write_op.cc:641] Partition lock acquired for write op
0807 15:11:09.283280 (+ 54us) tablet.cc:683] Acquiring locks for 8 operations
0807 15:11:09.283997 (+ 717us) tablet.cc:699] Row locks acquired
0807 15:11:09.284012 (+ 15us) write_op.cc:260] PREPARE: finished
0807 15:11:09.284171 (+ 159us) write_op.cc:270] Start()
0807 15:11:09.284296 (+ 125us) write_op.cc:276] Timestamp: P: 1786115469284122 usec, L: 0
0807 15:11:09.284313 (+ 17us) op_driver.cc:331] REPLICATION: starting
0807 15:11:09.372037 (+ 87724us) log.cc:842] Serialized 3302 byte log entry
0807 15:11:09.636022 (+263985us) op_driver.cc:444] REPLICATION: finished
0807 15:11:10.184046 (+548024us) write_op.cc:301] APPLY: starting
0807 15:11:10.184159 (+ 113us) tablet.cc:1365] starting BulkCheckPresence
0807 15:11:10.184428 (+ 269us) tablet.cc:1368] finished BulkCheckPresence
0807 15:11:10.184588 (+ 160us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:11:10.185701 (+ 1113us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:11:10.185942 (+ 241us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0807 15:11:10.185987 (+ 45us) write_op.cc:312] APPLY: finished
0807 15:11:10.186226 (+ 239us) log.cc:842] Serialized 65 byte log entry
0807 15:11:10.186416 (+ 190us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:10.186541 (+ 125us) write_op.cc:454] Released schema lock
0807 15:11:10.186590 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0807 15:11:10.186886 (+ 296us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:10.186912 (+ 26us) write_op.cc:454] Released schema lock
0807 15:11:10.272418 (+ 85506us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b18000d1020. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94dba5382c 00007f94d8e7e9dc 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e9be22 00007f94df7d4410 00007f94df7d4914 00007f94df7d6a78
Metrics: {"mutex_wait_us":26090,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":481404,"apply.run_cpu_time_us":3128,"apply.run_wall_time_us":3208,"num_ops":8,"prepare.queue_time_us":351439,"prepare.run_cpu_time_us":4531,"prepare.run_wall_time_us":149530,"replication_time_us":291168,"spinlock_wait_cycles":57922944,"thread_start_us":523345,"threads_started":2}]]}
I20260807 15:11:10.398360 29449 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:10.335141 976 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 15:11:10.345507 1012 log.cc:924] Time spent T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.095s user 0.001s sys 0.000s
I20260807 15:11:10.353995 29380 catalog_manager.cc:5495] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:10.410457 29450 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:10.314129 380 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:10.423019 796 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:10.423511 796 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 15:11:10.400095 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 58456.4us
W20260807 15:11:11.825232 29481 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.489s user 0.036s sys 0.033s
I20260807 15:11:10.406548 29533 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:10.407218 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 52735.4us
W20260807 15:11:11.941033 29479 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.611s user 0.026s sys 0.033s
I20260807 15:11:11.981004 1026 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:12.042779 29370 maintenance_manager.cc:419] P ce1e7c41f736452080b21dd983c40ba5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033748
I20260807 15:11:12.131114 1027 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:12.157997 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 1.73214e+06us
I20260807 15:11:12.160014 1028 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:12.203291 29380 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.790s user 0.058s sys 0.090s
W20260807 15:11:12.224689 29481 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.889s user 0.037s sys 0.034s
I20260807 15:11:12.227525 1029 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:12.228571 1030 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:12.230581 29640 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.887s user 0.018s sys 0.005s
I20260807 15:11:12.237836 1033 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:12.238857 1032 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:10.419875 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 49055.2us
W20260807 15:11:11.809414 30274 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.800s user 0.000s sys 0.008s
W20260807 15:11:12.469726 30274 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.460s user 0.002s sys 0.010s
I20260807 15:11:12.254559 1035 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.472605 1035 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.255908 1036 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.257321 1037 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:11:11.816642 30272 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.807s user 0.000s sys 0.007s
W20260807 15:11:12.274238 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 1.86747e+06us
I20260807 15:11:12.274834 1040 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:12.488232 1007 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:10.424584 380 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.294023 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.491700 29480 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:12.296137 1034 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:10.425346 796 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:10.399171 807 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:12.497634 807 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:10.352905 815 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260807 15:11:12.223060 814 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:10.424983 822 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:12.505821 814 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.506731 822 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:10.438730 931 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.508842 814 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.510221 931 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:10.289664 957 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:12.512048 30272 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.493s user 0.000s sys 0.009s
I20260807 15:11:12.512359 29484 raft_consensus.cc:1226] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:12.514369 957 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.140992 975 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:10.345804 1000 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:11.977545 821 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.131621 860 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:12.533004 821 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.533613 860 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.535475 821 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.167644 884 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:12.544109 1000 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:12.544647 884 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:10.422048 887 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:12.171846 928 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:10.378170 917 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:12.548941 917 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:12.130766 920 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:12.552611 931 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.552826 814 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:12.553376 1055 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:12.221376 932 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.554327 1055 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.554919 815 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:12.555017 932 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:10.395366 963 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:12.569161 884 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.433131 969 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.570317 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:10.408299 973 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:12.575587 29486 raft_consensus.cc:2354] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 9. Current term is 10.
I20260807 15:11:12.577522 963 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:12.578472 29486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 984) took 2255 ms (client timeout 1930 ms). Trace:
I20260807 15:11:12.580255 963 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.580345 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:10.429211 984 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.584800 984 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.386029 991 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:10.408702 992 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:10.346141 993 raft_consensus.cc:1067] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:10.442907 998 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:12.315579 1039 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.597880 1039 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:12.328866 29479 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.002s user 0.027s sys 0.034s
I20260807 15:11:12.335542 1028 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.601876 1028 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:12.338873 29640 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.996s user 0.019s sys 0.006s
I20260807 15:11:12.339178 1041 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:12.344151 29380 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.931s user 0.060s sys 0.090s
I20260807 15:11:12.348666 1026 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.604058 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:12.605082 30308 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 4
I20260807 15:11:12.606386 1026 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.349702 1027 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.604218 958 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:12.604102 29452 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:12.608826 1027 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.609117 958 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 15:11:12.609448 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 981) took 2386 ms. Trace:
I20260807 15:11:12.609844 29479 rpcz_store.cc:276] 0807 15:11:10.214832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:10.215394 (+ 562us) service_pool.cc:227] Handling call
0807 15:11:10.215774 (+ 380us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:10.216779 (+ 1005us) raft_consensus.cc:1520] Early marking committed up to index 7
0807 15:11:10.217115 (+ 336us) log.cc:842] Serialized 14 byte log entry
0807 15:11:12.600203 (+2383088us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:12.600292 (+ 89us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:12.600387 (+ 95us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:12.600616 (+ 229us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:12.600836 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9476,"prepare.queue_time_us":158,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":10490,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6755,"spinlock_wait_cycles":1723136,"thread_start_us":2373116,"threads_started":2,"wal-append.queue_time_us":216414,"wal-append.run_cpu_time_us":1274,"wal-append.run_wall_time_us":1045344}
I20260807 15:11:12.350759 1030 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.612869 969 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.613790 1030 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.352698 1033 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.615944 1039 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.358114 1044 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:12.616843 1044 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.617475 993 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:12.618176 993 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.619303 1044 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.364624 29450 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:12.620839 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 256525us
I20260807 15:11:12.621815 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:12.623342 30308 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:12.367986 30273 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:12.624135 958 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:11:12.625334 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 257857us
I20260807 15:11:12.348730 1032 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.627588 1032 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.372284 1031 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:12.628422 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:12.629246 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:12.628904 1031 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.630043 30312 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 10
I20260807 15:11:12.414662 1038 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:12.415222 1045 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:12.632351 1038 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.632474 1045 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.634821 1038 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.635463 1045 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.418502 1046 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:12.636327 1046 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.628305 963 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:12.631593 1031 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.427136 29608 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:12.638876 1046 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:12.639084 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 212310us
I20260807 15:11:12.426446 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3117) took 2115 ms. Trace:
I20260807 15:11:12.426708 1015 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:12.629288 29638 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:12.641045 1015 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.480093 1035 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.432513 1053 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.642711 1035 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:12.643196 1035 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:12.642908 1053 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.643611 1035 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:12.623420 29450 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:12.485602 29488 raft_consensus.cc:1226] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 2. Current term is 3. Ops: []
I20260807 15:11:12.488122 1040 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.489174 1007 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:12.579025 29486 rpcz_store.cc:269] 0807 15:11:10.323298 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:10.323607 (+ 309us) service_pool.cc:227] Handling call
0807 15:11:12.578156 (+2254549us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54001d47d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:12.578362 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5146228608}
I20260807 15:11:12.500690 29533 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.421180 1043 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:12.628229 998 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:12.646276 969 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:12.648414 1043 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.435027 1051 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.516470 29484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 983) took 2229 ms. Trace:
I20260807 15:11:12.650959 29484 rpcz_store.cc:276] 0807 15:11:10.286648 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:10.286771 (+ 123us) service_pool.cc:227] Handling call
0807 15:11:10.287079 (+ 308us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:12.512985 (+2225906us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:12.516119 (+ 3134us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54000d2854. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:12.516410 (+ 291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5116816256}
I20260807 15:11:12.651109 1051 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.528000 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:12.652035 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:12.537354 860 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:12.541157 29432 auto_rebalancer.cc:249] could not retrieve auto-rebalancing replica moves: Not found: table 31d0d00623fd4306950184679e10f7d3: could not find any suitable replica to move from server 4b092f7f951b4137b5d7810056684270 to server fbf78964d70448269802ac7de9d7a198
I20260807 15:11:12.547739 928 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.553105 920 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.479322 1037 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.170233 978 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.657745 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:12.658015 978 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.553421 931 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.553730 814 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.662700 814 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.556844 1055 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:10.375442 944 consensus_queue.cc:260] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.555496 815 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.666766 1037 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.571790 917 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.365862 1029 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.585549 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:12.638103 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.604164 1041 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.475642 1036 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.615944 1033 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.640066 29481 rpcz_store.cc:276] 0807 15:11:10.311322 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:10.316064 (+ 4742us) service_pool.cc:227] Handling call
0807 15:11:10.316368 (+ 304us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:10.316559 (+ 191us) raft_consensus.cc:1520] Early marking committed up to index 10
0807 15:11:12.351925 (+2035366us) log.cc:842] Serialized 14 byte log entry
0807 15:11:12.414048 (+ 62123us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:12.420369 (+ 6321us) raft_consensus.cc:1631] Marking committed up to 10
0807 15:11:12.425972 (+ 5603us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:12.426105 (+ 133us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:12.426334 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3414,"prepare.queue_time_us":1304400,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":36548,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":200,"thread_start_us":2056110,"threads_started":3,"wal-append.queue_time_us":37080}
I20260807 15:11:12.507175 822 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:12.515425 835 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:12.662516 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.561357 932 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.664674 1007 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.636722 30273 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:12.668030 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 179169us
I20260807 15:11:12.700662 29565 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:12.701323 29533 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.701639 29642 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:12.689355 1032 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:12.691449 1051 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.690596 1053 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.669613 1029 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:12.669852 926 consensus_queue.cc:1159] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "00dd11bf8fd9487580aba733c2996a4a" responder_term: 5 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 15:11:12.668038 815 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.677287 928 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.692499 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.707551 1036 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.707582 29641 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:11:12.678277 920 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.709753 29449 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:11:12.709821 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 73273.6us
I20260807 15:11:12.711241 30273 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:11:12.647423 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 89722.3us
I20260807 15:11:12.711763 29449 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:12.712554 29609 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:12.712770 991 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:12.713236 991 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:12.713788 991 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:12.714399 1041 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.715029 1041 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:11:12.716347 815 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:12.685866 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.716928 815 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:12.717341 815 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:12.678237 931 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.669586 917 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.690603 978 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.719482 835 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.696570 1043 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.673125 1015 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.702297 1044 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:12.724725 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.725528 29488 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:11:12.697444 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 74107.2us
I20260807 15:11:12.726817 29450 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:12.727057 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:12.727934 29479 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 6
I20260807 15:11:12.731173 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:12.732085 30303 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:11:12.733510 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.665114 1040 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.704001 29533 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.742252 29452 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:11:12.748377 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 216754us
W20260807 15:11:12.750694 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 217201us
I20260807 15:11:12.754273 29452 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:12.758277 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.753175 920 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:12.748014 1040 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:12.761456 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.761705 835 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.761878 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:12.781093 796 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.782948 29450 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:12.762236 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 51147.3us
I20260807 15:11:12.783885 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.784346 29569 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e0c073edf1454d1589526a840754b5da"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:11:12.784639 30273 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.784971 29567 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:12.785292 29569 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:11:12.785871 29569 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:12.786724 796 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.753263 1031 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:12.787432 1031 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:12.762611 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 58844.5us
I20260807 15:11:12.787794 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.760334 807 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.765581 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.788707 29560 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:12.789510 29480 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:12.790174 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.790704 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.790984 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.791428 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:12.792191 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:12.753206 1007 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260807 15:11:12.771919 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.776008 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:12.776566 29609 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.196:43545 timed out after 1.746s (SENT) [suppressed 68 similar messages]
I20260807 15:11:12.776875 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.777017 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.777143 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:12.795742 29644 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:12.777487 969 raft_consensus.cc:2781] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:11:12.797171 969 raft_consensus.cc:686] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:12.798417 969 consensus_queue.cc:237] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.794909 29637 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 8.
I20260807 15:11:12.799441 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 15:11:12.772974 860 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:11:12.800309 860 raft_consensus.cc:686] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:12.801920 993 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.801645 860 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.778976 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.804226 29645 raft_consensus.cc:2454] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 1.
I20260807 15:11:12.804606 29638 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10.
I20260807 15:11:12.791007 29561 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:12.806615 29449 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:12.786620 30273 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.762856 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:12.787987 1031 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:12.764953 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.788616 29533 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.765920 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.788827 963 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:12.767365 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.766440 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.792229 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.792697 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.792259 29565 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:12.771338 958 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:12.860183 29647 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 15:11:12.854158 917 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:12.876631 29481 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:12.876912 996 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:12.877224 917 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.860041 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.807343 822 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.801640 30303 raft_consensus.cc:2379] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 9: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:12.854702 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.860808 1041 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader election won for term 10
I20260807 15:11:12.813441 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.866811 29485 raft_consensus.cc:1799] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Handling vote request from an unknown peer 4b092f7f951b4137b5d7810056684270
I20260807 15:11:12.868678 29479 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:12.861896 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:11:12.862226 30272 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:12.872469 29487 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 9: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:12.872895 29482 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
W20260807 15:11:12.872988 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 84585.5us
I20260807 15:11:12.872521 29570 raft_consensus.cc:2379] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:12.882468 29485 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 4: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:12.873162 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.873736 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.874465 29569 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.876435 1040 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:12.878880 29638 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:12.884851 29561 raft_consensus.cc:1799] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Handling vote request from an unknown peer 4b092f7f951b4137b5d7810056684270
I20260807 15:11:12.885600 29561 raft_consensus.cc:2396] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260807 15:11:12.885740 822 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.885857 917 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.881994 1015 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:12.869062 29642 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:12.791332 807 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.795540 978 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:11:12.889756 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 47175.9us
I20260807 15:11:12.877631 996 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.894634 815 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:12.895534 29569 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:12.895569 982 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:12.894394 29452 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:12.896378 963 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:12.896373 29565 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:12.897576 815 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.897891 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.898357 1041 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:11:12.900288 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 113872us
I20260807 15:11:12.901885 29450 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:12.870934 1046 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:12.893441 29640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35570 (request call id 806) took 2689 ms. Trace:
I20260807 15:11:12.903808 30272 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:12.906294 982 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:12.914117 982 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:12.913854 1035 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.910418 29533 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.916814 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:12.913247 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 136712us
I20260807 15:11:12.913542 29640 rpcz_store.cc:276] 0807 15:11:10.194795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:10.194915 (+ 120us) service_pool.cc:227] Handling call
0807 15:11:10.195243 (+ 328us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:10.195444 (+ 201us) raft_consensus.cc:1520] Early marking committed up to index 10
0807 15:11:10.195731 (+ 287us) log.cc:842] Serialized 14 byte log entry
0807 15:11:12.602721 (+2406990us) log.cc:842] Serialized 14 byte log entry
0807 15:11:12.865472 (+262751us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:12.871869 (+ 6397us) raft_consensus.cc:1631] Marking committed up to 10
0807 15:11:12.876286 (+ 4417us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:12.878572 (+ 2286us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:12.884057 (+ 5485us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14341,"prepare.queue_time_us":1253835,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":94,"raft.queue_time_us":70802,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":33423,"thread_start_us":2547760,"threads_started":3,"wal-append.queue_time_us":396999,"wal-append.run_cpu_time_us":1133,"wal-append.run_wall_time_us":1078508}
I20260807 15:11:12.920323 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.921459 996 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:12.917893 1040 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 15:11:12.913029 984 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:12.926664 30274 leader_election.cc:398] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 9. Current term is 10.
I20260807 15:11:12.927557 30274 leader_election.cc:401] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:11:12.927328 963 consensus_queue.cc:1046] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:12.923487 1041 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.929800 973 raft_consensus.cc:3032] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 15:11:12.930241 973 raft_consensus.cc:729] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:12.930734 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:12.932560 678 consensus_queue.cc:1046] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:12.935258 1007 raft_consensus.cc:3032] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:12.935961 1007 raft_consensus.cc:729] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:12.937702 944 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:12.931763 29485 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 7
I20260807 15:11:12.938930 30273 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:12.931349 973 consensus_queue.cc:260] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.944177 973 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:12.946173 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.946890 678 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:12.947273 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:12.948069 29641 raft_consensus.cc:2354] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7.
I20260807 15:11:12.948295 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.937474 1007 consensus_queue.cc:260] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:12.947587 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.949620 1007 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:12.950536 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:12.951160 29645 raft_consensus.cc:3032] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:12.951413 998 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:12.951440 29645 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:12.952307 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.953006 29645 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:12.953984 29645 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:12.894212 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:11:12.961344 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:12.969619 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:12.970985 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.970328 29483 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
W20260807 15:11:12.973266 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 69547.4us
I20260807 15:11:12.975129 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:12.975914 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 65633.8us
I20260807 15:11:12.975252 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.979236 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:12.980023 860 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:12.980166 29482 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:12.980901 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.981621 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.982280 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.982324 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:12.982334 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.972532 1015 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:12.993973 29561 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:12.982868 29565 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:12.986161 29379 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:12.988581 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.989913 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:12.977110 29487 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:12.980964 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:12.996219 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:12.975508 30312 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10.
I20260807 15:11:12.978575 30272 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:12.978354 29485 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:12.993100 29560 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:12.918138 1035 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:12.978238 29609 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:12.999552 29570 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:13.006330 30272 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:12.916738 807 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:12.992024 860 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.007081 29564 raft_consensus.cc:1226] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:13.007726 29568 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:13.007930 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.012290 29560 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:11:13.002532 30273 connection.cc:232] RPC call timeout handler was delayed by -2.1482594860717654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260807 15:11:13.014400 30273 connection.cc:232] RPC call timeout handler was delayed by -2.0775770460022613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
I20260807 15:11:13.005463 30274 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:13.015172 30273 connection.cc:232] RPC call timeout handler was delayed by -2.0045547010377049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260807 15:11:13.015542 30273 connection.cc:232] RPC call timeout handler was delayed by -1.9865821360144764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260807 15:11:13.016013 30273 connection.cc:232] RPC call timeout handler was delayed by -1.5910944730276242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260807 15:11:13.016348 30273 connection.cc:232] RPC call timeout handler was delayed by -1.5298944730311632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260807 15:11:13.018944 29645 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:12.998099 963 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 9. Current term is 10.
I20260807 15:11:13.022059 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.026156 29565 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:11:13.031250 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 169636us
I20260807 15:11:13.031519 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:13.031133 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:13.028097 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.033366 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.033875 29567 raft_consensus.cc:3037] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.035530 29450 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.032369 29564 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 11.
I20260807 15:11:13.013386 860 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:13.038481 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.008577 1058 raft_consensus.cc:2781] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:11:13.037545 29609 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.035306 835 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.041755 29570 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.036412 678 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:13.043017 29569 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:13.025494 996 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:13.032368 920 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:13.054168 29568 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:13.053382 917 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:13.062821 917 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.063252 917 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.041136 1058 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:13.053818 969 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.054584 996 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:13.088032 29531 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.089536 982 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.093590 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.100569 30312 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:11:13.101441 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 63157.9us
I20260807 15:11:13.095842 1058 raft_consensus.cc:3037] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:11:13.102811 1040 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:13.103229 1040 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.103521 29482 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.097416 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.104302 30305 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:11:13.097615 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.105753 996 raft_consensus.cc:3037] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:11:13.096117 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 70317.9us
I20260807 15:11:13.094466 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.103605 1040 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:11:13.097862 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 62439.2us
I20260807 15:11:13.095144 29560 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:13.098435 29570 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.113405 29609 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.115935 29569 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:13.118371 29608 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.119848 29608 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.115646 29567 raft_consensus.cc:2454] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.054250 807 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260807 15:11:13.128561 29533 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:13.131526 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 104619us
I20260807 15:11:13.142846 29609 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.090238 860 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.148618 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.143741 30310 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:13.149382 30306 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:13.123633 821 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:11:13.143953 30303 raft_consensus.cc:1226] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:13.151402 29450 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.155522 860 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:13.158574 978 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:13.180936 29609 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.188670 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:13.189412 29642 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.146119 926 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:13.147210 1032 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260807 15:11:13.159497 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 44054.8us
I20260807 15:11:13.143364 1038 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:13.165653 991 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.167546 982 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:13.168206 815 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:13.168565 984 raft_consensus.cc:2726] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:13.169665 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:13.080107 1031 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.205032 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:13.136487 1035 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:13.181957 29608 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.183995 1047 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:13.171881 1015 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:13.175330 992 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.193324 926 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.203107 1041 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:13.210718 29533 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.211227 29486 raft_consensus.cc:2379] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:13.211344 29608 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.195535 1038 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.213563 29480 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:13.193753 1057 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:13.214422 1036 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.204511 796 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:13.218159 29608 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.224622 29609 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:11:13.230489 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 79216.3us
I20260807 15:11:13.175231 996 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.207027 958 consensus_queue.cc:1046] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260807 15:11:13.234551 29380 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48690 (request call id 389) took 11848 ms (client timeout 15000 ms). Trace:
I20260807 15:11:13.209373 815 raft_consensus.cc:686] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.230098 1032 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:11:13.214479 926 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.207381 1035 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.230473 944 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:13.235720 1057 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.212467 1047 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.254119 29642 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:13.240222 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:13.241102 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.241966 931 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:13.242452 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.242635 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.256191 30272 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.244146 807 consensus_queue.cc:1046] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 15:11:13.244422 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.246237 1031 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:13.246162 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.246811 1043 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:13.222424 1038 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.224107 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.252522 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.257537 30305 raft_consensus.cc:2354] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 9. Current term is 10.
I20260807 15:11:13.258888 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.263497 30309 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 3.
I20260807 15:11:13.248363 29609 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.258857 29450 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.259939 29608 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.264456 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.268054 29609 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.257376 931 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.257748 944 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.257476 1035 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:13.275648 30310 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 9: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:13.276059 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.277084 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:13.277413 815 consensus_queue.cc:237] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.275315 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.281055 1057 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:13.277902 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:13.282174 30309 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:13.282469 30312 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:13.281589 944 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:13.282949 29452 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.286067 1031 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:13.293413 29480 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
W20260807 15:11:13.250185 29380 rpcz_store.cc:269] 0807 15:11:01.386347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:01.386554 (+ 207us) service_pool.cc:227] Handling call
0807 15:11:12.604524 (+11217970us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:12.604583 (+ 59us) write_op.cc:454] Released schema lock
0807 15:11:13.234452 (+629869us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:11:11.658404 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:11:11.659132 (+ 728us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:11:11.659184 (+ 52us) write_op.cc:435] Acquired schema lock
0807 15:11:11.659208 (+ 24us) tablet.cc:660] Decoding operations
0807 15:11:11.660333 (+ 1125us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:11:11.660439 (+ 106us) write_op.cc:641] Partition lock acquired for write op
0807 15:11:11.660479 (+ 40us) tablet.cc:683] Acquiring locks for 5 operations
0807 15:11:11.661190 (+ 711us) tablet.cc:699] Row locks acquired
0807 15:11:11.661211 (+ 21us) write_op.cc:260] PREPARE: finished
0807 15:11:11.661407 (+ 196us) write_op.cc:270] Start()
0807 15:11:11.661549 (+ 142us) write_op.cc:276] Timestamp: P: 1786115471661342 usec, L: 0
0807 15:11:11.661578 (+ 29us) op_driver.cc:331] REPLICATION: starting
0807 15:11:11.816762 (+155184us) log.cc:842] Serialized 2084 byte log entry
0807 15:11:11.825096 (+ 8334us) op_driver.cc:444] REPLICATION: finished
0807 15:11:11.826383 (+ 1287us) write_op.cc:301] APPLY: starting
0807 15:11:11.826468 (+ 85us) tablet.cc:1365] starting BulkCheckPresence
0807 15:11:11.826639 (+ 171us) tablet.cc:1368] finished BulkCheckPresence
0807 15:11:11.826785 (+ 146us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:11:11.827579 (+ 794us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:11:11.827827 (+ 248us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0807 15:11:11.828073 (+ 246us) write_op.cc:312] APPLY: finished
0807 15:11:11.828371 (+ 298us) log.cc:842] Serialized 47 byte log entry
0807 15:11:11.829229 (+ 858us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:11.829348 (+ 119us) write_op.cc:454] Released schema lock
0807 15:11:11.829383 (+ 35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":8129,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":1025,"apply.run_cpu_time_us":2485,"apply.run_wall_time_us":3414,"num_ops":5,"prepare.queue_time_us":1245558,"prepare.run_cpu_time_us":5898,"prepare.run_wall_time_us":160522,"raft.queue_time_us":2456,"raft.run_cpu_time_us":1230,"raft.run_wall_time_us":1268,"replication_time_us":163393,"thread_start_us":2195881,"threads_started":4,"wal-append.queue_time_us":2093,"wal-append.run_cpu_time_us":5486,"wal-append.run_wall_time_us":1010416}]]}
I20260807 15:11:13.306710 30309 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:13.308969 996 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:11:13.309612 29670 debug-util.cc:398] Leaking SignalData structure 0x7b08000abf60 after lost signal to thread 28230
I20260807 15:11:13.310506 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:13.298303 917 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:13.310779 29670 debug-util.cc:398] Leaking SignalData structure 0x7b080009d420 after lost signal to thread 29417
W20260807 15:11:13.313482 29670 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0fc0 after lost signal to thread 29514
W20260807 15:11:13.314778 29670 debug-util.cc:398] Leaking SignalData structure 0x7b080030ab60 after lost signal to thread 29594
W20260807 15:11:13.315058 29670 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4b80 after lost signal to thread 29595
W20260807 15:11:13.316357 29670 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1520 after lost signal to thread 29674
I20260807 15:11:13.316882 30306 raft_consensus.cc:1799] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Handling vote request from an unknown peer 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.317694 931 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:11:13.317813 29670 debug-util.cc:398] Leaking SignalData structure 0x7b08002eda40 after lost signal to thread 30341
I20260807 15:11:13.317946 30306 raft_consensus.cc:2396] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260807 15:11:13.318177 29670 debug-util.cc:398] Leaking SignalData structure 0x7b08003962c0 after lost signal to thread 30342
I20260807 15:11:13.321771 917 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:11:13.324286 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 80056.7us
I20260807 15:11:13.325409 29533 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.326447 807 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.327131 928 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:13.327669 928 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.328078 928 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.328928 944 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.261965 1043 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.332265 1043 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.294674 1058 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.336117 29533 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.260720 1065 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 15:11:13.282294 1036 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:13.339187 991 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:13.339619 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 80879.5us
I20260807 15:11:13.340063 991 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:13.340456 767 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:13.340683 29450 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.341010 767 raft_consensus.cc:686] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.342106 767 consensus_queue.cc:237] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.342419 29450 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.342492 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:13.343681 29640 raft_consensus.cc:3037] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:11:13.339807 30303 raft_consensus.cc:2379] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 2: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:13.351842 1065 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:13.353207 1065 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.356144 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:13.359768 29533 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.360945 821 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:13.361939 29533 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.362816 821 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:11:13.362890 991 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:11:13.345793 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 77826.6us
I20260807 15:11:13.364076 29609 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.367592 822 raft_consensus.cc:2781] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:13.344450 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:13.269002 1032 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.347465 796 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:13.348089 1036 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:11:13.348239 958 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:13.360038 807 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.363418 821 raft_consensus.cc:686] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:13.369222 29533 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.347118 1046 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:13.387547 1032 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:13.387833 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:13.388522 29481 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.391449 29450 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.396508 29482 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:13.396593 991 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:13.397359 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.397838 821 consensus_queue.cc:237] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.398847 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.399809 29481 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.386507 1036 raft_consensus.cc:686] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:11:13.408227 30273 leader_election.cc:334] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.530s (SENT)
I20260807 15:11:13.373117 1058 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:13.415838 30273 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.376519 944 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:13.405299 1032 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:13.429104 29640 raft_consensus.cc:2454] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 2.
W20260807 15:11:13.434938 29450 connection.cc:232] RPC call timeout handler was delayed by -1.7910135769634508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260807 15:11:13.435341 29450 connection.cc:232] RPC call timeout handler was delayed by -1.596126694988925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260807 15:11:13.435583 29450 connection.cc:232] RPC call timeout handler was delayed by -1.2721779479761608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260807 15:11:13.435823 29450 connection.cc:232] RPC call timeout handler was delayed by -1.2334779480006546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260807 15:11:13.436163 29450 connection.cc:232] RPC call timeout handler was delayed by -1.2190779480151832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260807 15:11:13.437204 30309 raft_consensus.cc:1226] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:13.443847 29483 raft_consensus.cc:2454] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:13.447180 30272 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:13.426321 1058 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:13.417165 807 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.450207 1065 raft_consensus.cc:2781] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 2 FOLLOWER]: Leader election won for term 2
W20260807 15:11:13.450750 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 52066.5us
I20260807 15:11:13.455408 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:11:13.455868 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 51176.5us
I20260807 15:11:13.460608 29484 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.454743 926 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.464434 1041 consensus_queue.cc:1046] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260807 15:11:13.465291 926 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:13.465399 1041 consensus_queue.cc:1225] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer fbf78964d70448269802ac7de9d7a198 log is divergent from this leader: its last log entry 9.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260807 15:11:13.468163 29640 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260807 15:11:13.466228 30273 leader_election.cc:334] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.671s (SENT)
I20260807 15:11:13.475497 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.476560 29645 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260807 15:11:13.477838 1041 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:13.484467 1033 raft_consensus.cc:3032] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:13.485018 1033 raft_consensus.cc:729] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:13.486158 1033 consensus_queue.cc:260] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.497134 931 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.471261 1043 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.498224 969 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260807 15:11:13.498651 29642 raft_consensus.cc:2379] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 6: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:13.500044 1033 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.500572 1043 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:13.501363 1032 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:13.502584 29533 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.471978 1065 raft_consensus.cc:686] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:13.503854 1044 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:13.504755 1065 consensus_queue.cc:237] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.506528 928 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.510326 29609 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:13.511665 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.513702 1035 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.462060 1040 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.516081 29533 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.517006 1044 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:13.517231 1040 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:13.517514 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:13.518220 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 57386.8us
W20260807 15:11:13.519047 30273 leader_election.cc:334] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.739s (SENT)
I20260807 15:11:13.519418 30273 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.520337 1058 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 15:11:13.520742 30273 leader_election.cc:334] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.753s (SENT)
I20260807 15:11:13.521281 30273 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.522065 1058 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:13.523782 1047 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:13.461517 1036 consensus_queue.cc:237] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.534623 917 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:13.535005 1075 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:13.535174 917 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.535743 917 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:13.458155 822 raft_consensus.cc:686] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.539084 29609 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:13.539953 29484 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 9.
I20260807 15:11:13.543646 29640 raft_consensus.cc:1226] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:13.462262 1038 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:13.548192 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 289550us
I20260807 15:11:13.549746 29608 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.552552 29642 raft_consensus.cc:1226] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:11:13.548977 1040 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:13.551453 992 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Stepping down as leader of term 8
W20260807 15:11:13.585507 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 64831.4us
I20260807 15:11:13.583123 29608 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.557201 944 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:13.588891 29482 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
W20260807 15:11:13.588691 29450 leader_election.cc:334] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.751s (SENT)
I20260807 15:11:13.592816 29450 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.557750 1047 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 15:11:13.595918 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:13.596443 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:13.597127 29486 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.598549 931 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:13.599339 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:13.600041 29480 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.603869 822 consensus_queue.cc:237] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:13.604651 1035 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:13.605819 928 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:13.606773 29481 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:13.607530 29486 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.608889 29480 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.611214 29608 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.612421 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.613826 1082 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election won for term 7
W20260807 15:11:13.597291 30273 leader_election.cc:334] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.754s (SENT)
I20260807 15:11:13.616457 30273 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.589138 992 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:13.624639 30306 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260807 15:11:13.624912 1040 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:11:13.625329 1041 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:13.594559 30303 raft_consensus.cc:1226] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [term 2 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []
I20260807 15:11:13.595350 944 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:13.630807 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.631098 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.637754 29560 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.637874 29570 raft_consensus.cc:2379] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:13.631690 29533 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.631866 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.632650 29531 leader_election.cc:398] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7.
I20260807 15:11:13.640157 29531 leader_election.cc:401] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260807 15:11:13.637115 821 consensus_queue.cc:1035] T 9b21bbc939b9464c8729e18e5401dd65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260807 15:11:13.640980 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:13.595135 958 consensus_queue.cc:1046] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 8.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260807 15:11:13.632866 1038 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:13.595016 1047 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:13.642473 1047 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Advancing to term 12
I20260807 15:11:13.634953 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.596735 1015 consensus_queue.cc:1046] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260807 15:11:13.632995 1082 raft_consensus.cc:686] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.644290 29564 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:11:13.645175 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 56514.3us
I20260807 15:11:13.641640 29565 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:13.646589 1082 consensus_queue.cc:237] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.644731 29568 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:11:13.644316 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 47061.2us
W20260807 15:11:13.650007 30273 leader_election.cc:334] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.755s (SENT)
W20260807 15:11:13.650611 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 60452us
I20260807 15:11:13.627300 982 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:13.649160 944 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:13.657872 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.660511 1041 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260807 15:11:13.661074 1015 raft_consensus.cc:3032] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Stepping down as leader of term 1
I20260807 15:11:13.661520 1015 raft_consensus.cc:729] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:13.662479 992 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.663720 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.664343 992 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.664690 29531 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:11:13.664915 29450 leader_election.cc:334] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 1.936s (SENT)
I20260807 15:11:13.665472 29450 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.663102 29533 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.664400 29561 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.650106 1043 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:13.648416 917 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.670374 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.674384 29565 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.670889 29609 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.671030 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.675051 29568 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:13.680354 1041 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.690718 29609 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.692123 29560 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 9.
I20260807 15:11:13.693542 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:13.696570 29645 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 6: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:13.668489 1044 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:13.668517 1040 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7.
I20260807 15:11:13.695724 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.709501 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:13.699462 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.694607 931 raft_consensus.cc:2781] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:13.681075 1076 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
W20260807 15:11:13.704213 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 52903.4us
I20260807 15:11:13.704423 1047 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.681196 821 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:13.707934 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.724323 29637 raft_consensus.cc:1226] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:13.697475 993 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 15:11:13.708802 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:13.729945 30309 raft_consensus.cc:2362] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7. Re-sending same reply.
I20260807 15:11:13.709615 29567 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.683801 29565 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.717566 29640 raft_consensus.cc:1226] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260807 15:11:13.717711 29564 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.697978 1078 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 15:11:13.749927 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 50545.3us
I20260807 15:11:13.751672 993 raft_consensus.cc:686] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 9 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:11:13.754123 29450 leader_election.cc:334] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.141s (SENT)
I20260807 15:11:13.754791 29642 raft_consensus.cc:1226] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 12 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 11. Current term is 12. Ops: []
I20260807 15:11:13.752099 926 raft_consensus.cc:3032] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:13.662496 1015 consensus_queue.cc:260] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.721416 1040 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.790891 29567 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.752362 917 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:13.797700 1040 consensus_queue.cc:1046] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 15:11:13.717402 1043 raft_consensus.cc:686] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.799437 1040 raft_consensus.cc:3032] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:13.799201 1043 consensus_queue.cc:237] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.752427 931 raft_consensus.cc:686] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.800984 931 consensus_queue.cc:237] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.801579 29533 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.758766 926 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.803045 1033 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:13.802747 926 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.804116 926 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.804685 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:13.799849 1040 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:13.763794 1015 raft_consensus.cc:3037] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:11:13.807240 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:13.808048 29564 raft_consensus.cc:2379] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:13.764261 982 consensus_queue.cc:1046] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 15:11:13.767977 969 consensus_queue.cc:1159] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fbf78964d70448269802ac7de9d7a198" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 15:11:13.808862 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:13.806423 1040 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.771071 767 consensus_queue.cc:1046] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 15:11:13.745868 821 raft_consensus.cc:686] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:13.810571 917 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:13.810938 917 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.757815 29450 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.796775 993 consensus_queue.cc:237] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.797103 973 consensus_queue.cc:1046] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 15:11:13.809535 29569 raft_consensus.cc:2454] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:11:13.809571 982 raft_consensus.cc:3032] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:13.770466 29609 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.822114 958 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 15:11:13.824254 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 53904us
I20260807 15:11:13.825047 29609 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.825937 29609 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:13.829259 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:13.829945 29609 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.830896 29609 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:13.832623 29481 raft_consensus.cc:2379] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 6: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:13.833081 29609 leader_election.cc:398] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 9. Current term is 10.
I20260807 15:11:13.833395 29609 leader_election.cc:401] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:11:13.834254 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:13.834872 29486 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 6
I20260807 15:11:13.837210 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:13.837880 30306 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.838204 29609 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.839843 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:13.840533 29480 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:13.822801 982 raft_consensus.cc:729] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:13.839099 996 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 10
I20260807 15:11:13.810945 821 consensus_queue.cc:237] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:13.843807 982 consensus_queue.cc:260] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.835786 1038 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:13.845309 1038 raft_consensus.cc:686] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.837095 1082 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:13.845989 1082 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:13.824069 1065 raft_consensus.cc:3032] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 11 LEADER]: Stepping down as leader of term 11
I20260807 15:11:13.842427 29609 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.834290 928 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.827966 767 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:13.828372 1080 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:13.837776 1040 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:13.859134 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.850920 1065 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:13.846400 1082 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:13.865669 29564 raft_consensus.cc:2396] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260807 15:11:13.870239 29486 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:13.870365 29480 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.811818 917 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.842320 822 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:11:13.873291 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 119181us
I20260807 15:11:13.859239 767 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:13.880915 767 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:13.862460 1075 raft_consensus.cc:2726] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:13.880419 917 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
W20260807 15:11:13.880203 1036 consensus_queue.cc:1159] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fbf78964d70448269802ac7de9d7a198" responder_term: 8 status { last_received { term: 8 index: 10 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 10 } }
I20260807 15:11:13.889467 29640 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 9 index: 12. (index mismatch)
W20260807 15:11:13.891253 29450 leader_election.cc:334] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.184s (SENT)
I20260807 15:11:13.891789 29450 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:13.893050 29450 leader_election.cc:334] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.200s (SENT)
I20260807 15:11:13.892900 944 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.893447 29450 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:13.895195 969 raft_consensus.cc:2726] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:13.895256 29561 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.895530 944 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:13.895972 969 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:13.898363 30306 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:13.899603 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.901849 29569 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:11:13.901989 1057 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 15:11:13.899930 30312 raft_consensus.cc:1261] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:13.903877 1065 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.905293 1065 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Advancing to term 12
I20260807 15:11:13.846361 1038 consensus_queue.cc:237] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:13.907513 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 135523us
I20260807 15:11:13.900920 29568 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:13.914394 982 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:13.916146 1047 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 12 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:13.925253 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:13.925925 30309 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:13.916194 996 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for earlier term 9. Current term is 10.
I20260807 15:11:13.944370 969 consensus_queue.cc:1035] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:13.946612 1082 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:13.949342 1082 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:13.946727 29382 catalog_manager.cc:5495] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 7 to 8, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 8 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260807 15:11:13.954861 1095 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.064s user 0.001s sys 0.000s
W20260807 15:11:13.956354 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 85083.7us
I20260807 15:11:13.956462 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.973251 29568 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:13.955518 29608 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.973717 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:13.873750 1080 raft_consensus.cc:686] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:13.978259 29480 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:11:13.957999 29569 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 3.
I20260807 15:11:13.958182 30309 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:13.973161 29382 catalog_manager.cc:5495] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:13.981745 29608 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.983392 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:13.982583 29382 catalog_manager.cc:5495] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 4 to 5, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 5 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } }
I20260807 15:11:13.985225 29608 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:13.985505 29382 catalog_manager.cc:5495] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 8 to 11, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 11 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:13.987120 29382 catalog_manager.cc:5495] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 6 to 9, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 9 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:13.990617 29569 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:13.990485 29382 catalog_manager.cc:5495] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 7 to 8, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 4b092f7f951b4137b5d7810056684270 (127.27.144.195). New cstate: current_term: 8 leader_uuid: "4b092f7f951b4137b5d7810056684270" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:11:13.996989 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:13.999308 29640 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:14.000924 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:14.001605 29567 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Advancing to term 12
I20260807 15:11:14.005357 29382 catalog_manager.cc:5495] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 5 to 6, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 6 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:14.006964 29382 catalog_manager.cc:5495] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 reported cstate change: term changed from 3 to 4, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to fbf78964d70448269802ac7de9d7a198 (127.27.144.196). New cstate: current_term: 4 leader_uuid: "fbf78964d70448269802ac7de9d7a198" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:14.014323 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:14.014860 29609 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.016088 29609 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.011807 29567 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 12.
I20260807 15:11:13.990306 917 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:13.996953 1082 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:14.022807 796 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:11:13.995548 996 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 15:11:13.973007 767 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:14.024237 29379 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59990 (request call id 221) took 12577 ms (client timeout 15000 ms). Trace:
I20260807 15:11:14.027467 29609 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:14.029178 926 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:11:14.038283 1082 raft_consensus.cc:686] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:14.039409 1082 consensus_queue.cc:237] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.041500 767 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:11:14.046422 29367 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fbf78964d70448269802ac7de9d7a198 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:14.050338 29564 raft_consensus.cc:1261] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 15:11:14.056663 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:14.001008 1043 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:14.028654 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:14.004830 963 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260807 15:11:14.059127 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:14.027820 29568 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:14.061060 993 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:11:14.064401 993 raft_consensus.cc:686] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:14.065742 993 consensus_queue.cc:237] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.066516 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:14.067462 30306 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:14.088835 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:14.089538 29568 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:14.034315 917 raft_consensus.cc:686] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:11:14.035182 29379 rpcz_store.cc:269] 0807 15:11:01.446562 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:01.446807 (+ 245us) service_pool.cc:227] Handling call
0807 15:11:14.024169 (+12577362us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:11:13.383759 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:11:13.384600 (+ 841us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:11:13.384670 (+ 70us) write_op.cc:435] Acquired schema lock
0807 15:11:13.384708 (+ 38us) tablet.cc:660] Decoding operations
0807 15:11:13.406289 (+ 21581us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:11:13.424668 (+ 18379us) write_op.cc:641] Partition lock acquired for write op
0807 15:11:13.429566 (+ 4898us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:11:13.438883 (+ 9317us) tablet.cc:699] Row locks acquired
0807 15:11:13.438937 (+ 54us) write_op.cc:260] PREPARE: finished
0807 15:11:13.439184 (+ 247us) write_op.cc:270] Start()
0807 15:11:13.439405 (+ 221us) write_op.cc:276] Timestamp: P: 1786115473439101 usec, L: 0
0807 15:11:13.439458 (+ 53us) op_driver.cc:331] REPLICATION: starting
0807 15:11:13.440519 (+ 1061us) log.cc:842] Serialized 539 byte log entry
0807 15:11:13.785926 (+345407us) op_driver.cc:444] REPLICATION: finished
0807 15:11:13.862379 (+ 76453us) write_op.cc:301] APPLY: starting
0807 15:11:13.862481 (+ 102us) tablet.cc:1365] starting BulkCheckPresence
0807 15:11:13.873005 (+ 10524us) tablet.cc:1368] finished BulkCheckPresence
0807 15:11:13.875771 (+ 2766us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:11:13.876085 (+ 314us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:11:13.876477 (+ 392us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 15:11:13.876545 (+ 68us) write_op.cc:312] APPLY: finished
0807 15:11:13.876851 (+ 306us) log.cc:842] Serialized 23 byte log entry
0807 15:11:13.877048 (+ 197us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:13.877140 (+ 92us) write_op.cc:454] Released schema lock
0807 15:11:13.877192 (+ 52us) write_op.cc:341] FINISH: Updating metrics
0807 15:11:13.877582 (+ 390us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:13.877613 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":269945,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":72837,"apply.run_cpu_time_us":3245,"apply.run_wall_time_us":15524,"num_ops":1,"prepare.queue_time_us":149500,"prepare.run_cpu_time_us":12417,"prepare.run_wall_time_us":161140,"raft.queue_time_us":127000,"raft.run_cpu_time_us":7787,"raft.run_wall_time_us":51524,"replication_time_us":346344,"spinlock_wait_cycles":6005504,"thread_start_us":334941,"threads_started":4,"wal-append.queue_time_us":145938}]]}
I20260807 15:11:14.099540 29486 raft_consensus.cc:1261] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 15:11:14.095569 30306 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:14.102190 29640 raft_consensus.cc:1226] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:14.102421 29564 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:11:14.102371 30306 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 15:11:14.112206 29608 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:14.112802 29481 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 15:11:14.113844 29568 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:14.114615 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:14.115520 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:14.116078 30305 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:14.120126 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:14.120740 29483 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 6
I20260807 15:11:14.054647 821 consensus_queue.cc:1046] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260807 15:11:14.042404 1080 consensus_queue.cc:237] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:14.132117 1047 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 12 FOLLOWER]: Leader election won for term 12
I20260807 15:11:14.127269 1057 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:14.137642 1057 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.137674 821 raft_consensus.cc:3032] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:14.139071 821 raft_consensus.cc:729] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:14.140113 30308 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 12.
I20260807 15:11:14.141397 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.141816 29482 raft_consensus.cc:1261] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 9 index: 12. (index mismatch)
I20260807 15:11:14.142221 29486 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:14.103307 1043 raft_consensus.cc:686] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:14.144214 1007 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:14.144941 1007 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.145418 821 consensus_queue.cc:260] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.146782 30274 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:14.147013 821 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:14.148190 1007 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:14.148342 678 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:14.148928 678 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:14.149394 678 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:14.150441 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.151253 29486 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:11:14.144563 1043 consensus_queue.cc:237] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:14.152467 30274 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:14.153400 1058 raft_consensus.cc:2781] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:14.153484 1074 consensus_queue.cc:1035] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:11:14.153903 1058 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:14.154333 1058 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:14.054934 1078 consensus_queue.cc:1046] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260807 15:11:14.162215 917 consensus_queue.cc:237] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:14.165282 29642 raft_consensus.cc:1261] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 15:11:14.174252 29483 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:14.161437 1057 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:14.182571 29608 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
W20260807 15:11:14.184527 29432 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 9bbe5c211ab64989a57350f34f007ced is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } }
I20260807 15:11:14.188014 1074 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:14.190186 29609 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:14.184173 1057 consensus_queue.cc:1035] T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:11:14.196966 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:14.197697 29485 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:14.198369 30305 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:14.200881 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.201059 30307 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:14.191659 996 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260807 15:11:14.203292 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.204411 1044 consensus_queue.cc:1046] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 15:11:14.202606 29564 raft_consensus.cc:1261] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 15:11:14.202582 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.173686 1047 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 12 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:14.209692 767 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:11:14.211074 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:14.212546 29450 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.215116 29484 raft_consensus.cc:1226] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:14.217852 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.221765 30307 raft_consensus.cc:1226] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:14.223281 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:14.189949 1074 raft_consensus.cc:686] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:14.224642 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.226197 30305 raft_consensus.cc:2396] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260807 15:11:14.229070 29485 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:14.230903 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:14.214558 1044 raft_consensus.cc:3032] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:14.240859 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:14.246151 29484 raft_consensus.cc:1261] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 15:11:14.247184 29450 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.248052 29480 raft_consensus.cc:1226] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:14.248203 29609 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:14.249032 29450 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:14.250732 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:14.252672 30306 raft_consensus.cc:2354] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7.
I20260807 15:11:14.253186 29450 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.255195 1109 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:14.240693 992 raft_consensus.cc:2781] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:11:14.267144 29567 raft_consensus.cc:1261] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 15:11:14.224623 767 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260807 15:11:14.265924 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:14.241863 1044 raft_consensus.cc:729] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:14.277716 30307 raft_consensus.cc:2396] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260807 15:11:14.280647 1100 log.cc:924] Time spent T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20260807 15:11:14.282828 1058 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:14.273043 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 995314457256466c935b10a561d7003e, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:14.256067 1041 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:14.260960 958 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:11:14.265866 30303 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
W20260807 15:11:14.289633 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 995314457256466c935b10a561d7003e, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:14.298990 29640 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:14.267346 1075 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:14.212049 1047 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.268431 991 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:11:14.253243 1036 consensus_queue.cc:1035] T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260807 15:11:14.303822 29567 raft_consensus.cc:1261] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 15:11:14.292234 1041 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:14.297648 992 raft_consensus.cc:686] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:14.305287 1074 consensus_queue.cc:237] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:14.291697 926 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260807 15:11:14.289835 931 consensus_queue.cc:1035] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260807 15:11:14.310093 1075 raft_consensus.cc:686] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:14.318580 1041 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:14.321545 991 raft_consensus.cc:686] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
W20260807 15:11:14.373721 1103 log.cc:924] Time spent T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.058s user 0.000s sys 0.001s
I20260807 15:11:14.285815 1109 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.318033 1038 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260807 15:11:14.410380 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:14.410831 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:14.415117 29560 raft_consensus.cc:1226] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:14.417492 29567 raft_consensus.cc:2354] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 11. Current term is 12.
I20260807 15:11:14.417526 29565 raft_consensus.cc:2354] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 6. Current term is 7.
I20260807 15:11:14.419951 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:14.318854 1108 consensus_queue.cc:1046] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260807 15:11:14.316685 1044 consensus_queue.cc:260] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:14.429946 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:14.435509 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:14.437610 29567 raft_consensus.cc:1226] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260807 15:11:14.445755 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:14.446527 29570 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:11:14.446911 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:14.447320 29533 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:14.447772 29567 raft_consensus.cc:2396] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260807 15:11:14.448586 29533 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:14.439285 678 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.437641 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:14.453855 29533 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:14.465790 678 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:14.441749 1109 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:14.322851 992 consensus_queue.cc:237] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.450073 1078 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:14.450088 1112 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:14.455204 30273 leader_election.cc:398] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 election: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 11. Current term is 12.
I20260807 15:11:14.456463 991 consensus_queue.cc:237] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.453169 30307 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:14.426842 1075 consensus_queue.cc:237] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.452649 29563 raft_consensus.cc:1226] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:14.450513 29483 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 15:11:14.440809 1058 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:14.474376 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:14.435159 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:11:14.635021 29487 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:14.548431 969 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:14.531494 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 52489.4us
I20260807 15:11:14.532804 29570 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260807 15:11:14.529567 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 75785.4us
I20260807 15:11:14.641886 29533 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:14.529762 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 52194.3us
W20260807 15:11:14.546600 1040 consensus_meta.cc:287] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.674s user 0.008s sys 0.004s
I20260807 15:11:14.529477 1044 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:11:14.529376 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 56872.9us
W20260807 15:11:14.455268 1110 log.cc:924] Time spent T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.081s user 0.001s sys 0.000s
I20260807 15:11:14.603057 860 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:14.678313 860 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.679203 29533 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.680696 860 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:14.566620 1108 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:14.680730 1118 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:14.602291 29382 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48700 (request call id 376) took 1522 ms. Trace:
I20260807 15:11:14.683202 29382 rpcz_store.cc:276] 0807 15:11:13.064540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:13.064762 (+ 222us) service_pool.cc:227] Handling call
0807 15:11:14.586773 (+1522011us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:11:14.047790 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:11:14.048321 (+ 531us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:11:14.048356 (+ 35us) write_op.cc:435] Acquired schema lock
0807 15:11:14.048372 (+ 16us) tablet.cc:660] Decoding operations
0807 15:11:14.068653 (+ 20281us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:11:14.068750 (+ 97us) write_op.cc:641] Partition lock acquired for write op
0807 15:11:14.068791 (+ 41us) tablet.cc:683] Acquiring locks for 8 operations
0807 15:11:14.069681 (+ 890us) tablet.cc:699] Row locks acquired
0807 15:11:14.069716 (+ 35us) write_op.cc:260] PREPARE: finished
0807 15:11:14.069918 (+ 202us) write_op.cc:270] Start()
0807 15:11:14.070058 (+ 140us) write_op.cc:276] Timestamp: P: 1786115474069855 usec, L: 0
0807 15:11:14.070091 (+ 33us) op_driver.cc:331] REPLICATION: starting
0807 15:11:14.070962 (+ 871us) log.cc:842] Serialized 3247 byte log entry
0807 15:11:14.076344 (+ 5382us) op_driver.cc:444] REPLICATION: finished
0807 15:11:14.105154 (+ 28810us) write_op.cc:301] APPLY: starting
0807 15:11:14.112336 (+ 7182us) tablet.cc:1365] starting BulkCheckPresence
0807 15:11:14.128668 (+ 16332us) tablet.cc:1368] finished BulkCheckPresence
0807 15:11:14.128800 (+ 132us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:11:14.129717 (+ 917us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:11:14.129989 (+ 272us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0807 15:11:14.130044 (+ 55us) write_op.cc:312] APPLY: finished
0807 15:11:14.130358 (+ 314us) log.cc:842] Serialized 65 byte log entry
0807 15:11:14.130543 (+ 185us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:14.130701 (+ 158us) write_op.cc:454] Released schema lock
0807 15:11:14.130750 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0807 15:11:14.131140 (+ 390us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:14.131177 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20217,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":11692,"apply.run_cpu_time_us":3793,"apply.run_wall_time_us":29651,"num_ops":8,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":4670,"prepare.run_wall_time_us":28517,"replication_time_us":6152}]]}
I20260807 15:11:14.653359 29569 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:14.686273 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.672225 1033 raft_consensus.cc:3032] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:14.660391 982 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:14.708755 29487 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 10.
W20260807 15:11:14.700588 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 254853us
I20260807 15:11:14.695305 29533 leader_election.cc:398] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7.
I20260807 15:11:14.713267 29533 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.716763 30274 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:14.717823 29533 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:14.719101 30273 leader_election.cc:398] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 6. Current term is 7.
I20260807 15:11:14.719012 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.719466 30273 leader_election.cc:401] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260807 15:11:14.652678 1123 raft_consensus.cc:2726] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:14.723575 29482 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 9: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:14.728363 29568 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 15:11:14.689000 1118 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260807 15:11:14.708504 1108 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:14.688779 1033 raft_consensus.cc:729] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:14.648082 969 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:14.730551 821 consensus_meta.cc:287] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.583s user 0.010s sys 0.006s
I20260807 15:11:14.685245 973 consensus_queue.cc:1035] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260807 15:11:14.721288 1109 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:14.745996 1065 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589) with higher term. Message: Invalid argument: T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for earlier term 6. Current term is 7.
I20260807 15:11:14.726493 1040 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:11:14.709805 767 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260807 15:11:14.709720 982 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.748340 1058 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader election won for term 10
W20260807 15:11:14.764402 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 47841.7us
I20260807 15:11:14.772469 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:14.773461 29642 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:14.776903 1124 consensus_queue.cc:1046] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260807 15:11:14.779665 821 raft_consensus.cc:3032] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:14.780124 821 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:14.780967 821 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.783105 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:11:14.783917 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 65916.7us
I20260807 15:11:14.783974 29568 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:14.785682 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:14.787050 29561 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 15:11:14.788575 29561 raft_consensus.cc:1261] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:11:14.790410 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.791477 29561 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 15:11:14.741524 1112 consensus_queue.cc:1046] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260807 15:11:14.794314 29481 raft_consensus.cc:2379] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 10: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:14.829937 29566 raft_consensus.cc:1261] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 15:11:14.853896 29568 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:14.857599 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:14.867925 29642 raft_consensus.cc:1261] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260807 15:11:14.874486 1131 log.cc:924] Time spent T f07d982710354dfca721e4641d589839 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
W20260807 15:11:14.875382 1117 log.cc:924] Time spent T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.242s user 0.001s sys 0.000s
I20260807 15:11:14.872718 1058 raft_consensus.cc:686] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [term 10 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
W20260807 15:11:14.875727 1125 log.cc:924] Time spent T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260807 15:11:14.876626 1058 consensus_queue.cc:237] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:14.878141 1106 log.cc:924] Time spent T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.519s user 0.000s sys 0.004s
I20260807 15:11:14.880951 1033 consensus_queue.cc:260] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:14.883080 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:14.856786 678 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:14.898615 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:14.856386 767 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260807 15:11:14.908056 1133 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:14.861784 931 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260807 15:11:14.911036 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:14.888411 678 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:14.866678 993 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260807 15:11:14.865548 796 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260807 15:11:14.926582 767 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:14.927316 767 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:14.928071 1130 log.cc:924] Time spent T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.100s user 0.000s sys 0.000s
I20260807 15:11:14.930246 767 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:14.899415 1112 consensus_queue.cc:1035] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260807 15:11:14.873145 1121 consensus_queue.cc:1035] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260807 15:11:14.915639 969 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:14.904603 1040 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:15.005162 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 51920.2us
W20260807 15:11:14.959287 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 131152us
I20260807 15:11:14.913561 992 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:15.012161 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 116156us
W20260807 15:11:15.011911 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 55640.2us
I20260807 15:11:15.014343 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.009940 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:14.932214 678 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:14.933240 982 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:14.908794 1133 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:15.038884 1132 log.cc:924] Time spent T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.158s user 0.002s sys 0.000s
I20260807 15:11:15.053216 821 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:15.013789 969 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.077256 29449 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:15.096400 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 385798us
I20260807 15:11:15.016466 1040 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.024835 992 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.112126 1142 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:15.086289 969 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.140156 1134 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:15.194347 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 177281us
I20260807 15:11:15.209403 30273 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:15.223153 29640 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:15.227576 30273 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:15.216144 991 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.233989 29642 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:15.235991 29568 raft_consensus.cc:1226] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:15.238639 982 raft_consensus.cc:2781] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:11:15.239336 982 raft_consensus.cc:686] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:15.226351 1144 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:15.198661 1134 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.282675 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:15.295393 29569 raft_consensus.cc:1261] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260807 15:11:15.270560 1152 log.cc:924] Time spent T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.103s user 0.001s sys 0.000s
W20260807 15:11:15.271492 1143 log.cc:924] Time spent T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.098s user 0.001s sys 0.000s
W20260807 15:11:15.272533 1151 log.cc:924] Time spent T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.096s user 0.001s sys 0.000s
I20260807 15:11:15.276548 1159 consensus_queue.cc:1046] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:15.279157 992 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.280372 1133 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:15.281409 1140 log.cc:924] Time spent T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.259s user 0.001s sys 0.000s
I20260807 15:11:15.236773 30273 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:15.235158 1142 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:15.320590 29609 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.072s user 0.020s sys 0.012s
I20260807 15:11:15.320394 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:15.334316 29609 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.085s user 0.020s sys 0.012s
W20260807 15:11:15.334885 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 1.0867e+06us
I20260807 15:11:15.303579 1124 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:15.334704 29642 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
W20260807 15:11:15.338042 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 102354us
I20260807 15:11:15.342875 29609 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a
W20260807 15:11:15.346822 29367 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fbf78964d70448269802ac7de9d7a198 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:15.351765 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:15.341356 963 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260807 15:11:15.356036 982 consensus_queue.cc:237] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.352339 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.357227 1134 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.357424 29563 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:15.353003 29481 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 9.
I20260807 15:11:15.363569 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:15.364859 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.365535 29569 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
W20260807 15:11:15.371445 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 108303us
I20260807 15:11:15.374472 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.375151 29569 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
W20260807 15:11:15.372352 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 140759us
I20260807 15:11:15.378614 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.381023 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:15.381304 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 117537us
I20260807 15:11:15.320045 991 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.382002 29640 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
I20260807 15:11:15.365885 1118 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.371079 944 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:11:15.360587 931 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260807 15:11:15.408464 29449 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:15.401412 29569 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:15.359589 1043 consensus_queue.cc:1035] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260807 15:11:15.399729 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:15.409761 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 55587.3us
I20260807 15:11:15.412868 29642 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
I20260807 15:11:15.344980 1142 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.414814 30309 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:15.418083 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:15.392696 969 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.389209 1134 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:15.418947 30312 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
I20260807 15:11:15.427512 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:15.428273 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:15.431877 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:15.396070 1040 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.432804 30312 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
I20260807 15:11:15.441246 991 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.429105 30307 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 9.
I20260807 15:11:15.450646 29533 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:15.452136 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:15.415519 1126 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.452832 29642 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 9.
W20260807 15:11:15.460417 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 43734.1us
I20260807 15:11:15.430104 944 raft_consensus.cc:686] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:15.465442 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.473229 1162 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:15.473966 1162 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.476862 1167 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.477612 1167 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.399583 1118 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.445863 969 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:15.460059 1109 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260807 15:11:15.512953 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 170202us
W20260807 15:11:15.513059 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 46651.3us
I20260807 15:11:15.518774 30273 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:15.522472 30273 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:11:15.509323 1041 consensus_meta.cc:287] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 1.089s user 0.007s sys 0.008s
I20260807 15:11:15.527058 29484 raft_consensus.cc:1261] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 15:11:15.529523 29567 raft_consensus.cc:1261] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 15:11:15.528226 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.529897 29486 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260807 15:11:15.517036 1140 log.cc:924] Time spent T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
W20260807 15:11:15.518962 1125 log.cc:924] Time spent T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.054s user 0.001s sys 0.000s
W20260807 15:11:15.535494 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 73542.8us
I20260807 15:11:15.540108 29484 raft_consensus.cc:1261] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:11:15.534282 29486 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:11:15.521549 1109 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:15.524668 1133 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:15.466461 1134 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.549013 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.552142 29486 raft_consensus.cc:1261] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 15:11:15.550472 30312 raft_consensus.cc:1226] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:15.464833 1126 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.529320 1040 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:15.550930 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 67808.9us
I20260807 15:11:15.525127 969 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.549113 1109 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:15.522209 678 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.549182 1144 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:15.553246 1133 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:15.573323 29479 raft_consensus.cc:1261] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 15:11:15.586690 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50980.4us
I20260807 15:11:15.591719 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:15.594555 29486 raft_consensus.cc:1261] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 15:11:15.533214 1041 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.563146 1162 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.549234 991 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260807 15:11:15.566040 944 consensus_queue.cc:237] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.602599 1168 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:15.572221 1172 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:15.587378 1040 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.604238 1142 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.606329 678 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.599182 1133 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:15.608083 1134 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.608911 969 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.609213 1118 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.603668 30303 raft_consensus.cc:1261] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260807 15:11:15.604176 821 consensus_meta.cc:287] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.550s user 0.013s sys 0.000s
W20260807 15:11:15.610204 1044 consensus_meta.cc:287] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.949s user 0.015s sys 0.000s
I20260807 15:11:15.611001 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.613554 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.614528 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.573118 1167 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.625316 30308 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:15.625973 29480 raft_consensus.cc:1226] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:15.596119 1144 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:15.629787 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:15.627091 1124 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 15:11:15.620172 1168 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:15.628974 1176 consensus_queue.cc:1035] T 18498fa007b248e9af1c1eaeee728541 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260807 15:11:15.651680 29564 raft_consensus.cc:1261] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 15:11:15.664150 29560 raft_consensus.cc:2396] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260807 15:11:15.667199 1184 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.628054 1172 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.668486 917 consensus_queue.cc:1035] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260807 15:11:15.672039 1179 log.cc:924] Time spent T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260807 15:11:15.672626 1137 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:15.672981 1126 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.673080 1170 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.661207 1144 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:15.673475 1173 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.696861 1173 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.699179 1173 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.673966 1175 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.699939 1175 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.702119 1175 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.680183 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:15.684116 29565 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260807 15:11:15.702826 29565 pending_rounds.cc:76] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Aborting all ops after (but not including) 9
I20260807 15:11:15.703101 29565 pending_rounds.cc:97] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260807 15:11:15.703637 29565 raft_consensus.cc:2866] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:11:15.709795 1033 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:15.709596 1170 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.694199 1137 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.715382 1174 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:15.690630 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 188026us
I20260807 15:11:15.671684 1109 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.694945 1154 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260807 15:11:15.695789 1188 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:15.741382 1188 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.680888 1184 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.745522 1184 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.703048 1172 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.718314 1182 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:15.746379 1182 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:15.747110 1040 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.748569 1182 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.690980 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.748844 1109 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.749056 1041 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.675726 1168 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:15.749349 29570 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:11:15.752117 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:15.752012 1174 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.752876 29486 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:15.754520 1174 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.723937 1170 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:15.755751 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.755954 1137 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.756496 29570 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
I20260807 15:11:15.756732 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.757364 29450 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:15.757432 29567 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
I20260807 15:11:15.760794 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:15.761046 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:15.756465 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:15.764308 30309 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:15.769163 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:15.769870 29479 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:15.770226 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:15.770885 29484 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:15.775851 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:15.776960 29483 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 9: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:15.780277 29533 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:15.781853 30273 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:15.782812 30273 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:11:15.687374 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 207757us
I20260807 15:11:15.785025 29449 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:15.782212 29637 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 9.
I20260807 15:11:15.798897 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.802455 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:15.810781 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.813778 29449 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:15.814821 29484 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 10.
W20260807 15:11:15.815182 1166 log.cc:924] Time spent T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.512s user 0.004s sys 0.000s
I20260807 15:11:15.743777 1188 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:15.819051 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:15.821524 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 192364us
I20260807 15:11:15.803731 1033 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:15.807210 1137 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:15.806452 678 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:15.806278 1041 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:15.835978 1041 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:15.836237 678 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:15.836441 1041 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:15.836742 678 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:15.838061 1036 consensus_queue.cc:1035] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:11:15.825747 1033 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:15.840508 1033 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:15.842038 815 consensus_queue.cc:1035] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:15.835491 1177 raft_consensus.cc:2741] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260807 15:11:15.849654 29567 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 15:11:15.834956 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:15.850684 29484 raft_consensus.cc:1261] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260807 15:11:15.821187 1109 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:15.852583 1109 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:15.853132 1109 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:15.856817 1141 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:11:15.859246 1150 log.cc:924] Time spent T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.663s user 0.000s sys 0.001s
I20260807 15:11:15.860687 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1031) took 1070 ms. Trace:
I20260807 15:11:15.838100 1145 raft_consensus.cc:3032] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:15.861806 1145 raft_consensus.cc:729] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:15.861174 29482 rpcz_store.cc:276] 0807 15:11:14.790157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:14.790554 (+ 397us) service_pool.cc:227] Handling call
0807 15:11:14.822791 (+ 32237us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:14.839996 (+ 17205us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:14.840045 (+ 49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:14.845944 (+ 5899us) log.cc:842] Serialized 26 byte log entry
0807 15:11:15.018019 (+172075us) raft_consensus.cc:1631] Marking committed up to 12
0807 15:11:15.197076 (+179057us) log.cc:842] Serialized 14 byte log entry
0807 15:11:15.261795 (+ 64719us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:15.261870 (+ 75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:15.858417 (+596547us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:11:15.860295 (+ 1878us) raft_consensus.cc:1671] finished
0807 15:11:15.860416 (+ 121us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:15.860575 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11296,"prepare.queue_time_us":210335,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":105154,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":44481,"spinlock_wait_cycles":6589312,"thread_start_us":381657,"threads_started":3,"wal-append.queue_time_us":254766}
I20260807 15:11:15.862998 1145 consensus_queue.cc:260] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:15.848641 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:15.829131 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:15.855304 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:15.876312 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:15.911736 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:15.912336 29642 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 6.
I20260807 15:11:15.912539 30309 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
I20260807 15:11:15.916395 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:15.830562 1137 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:15.922936 1043 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:11:15.947533 29570 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 9.
I20260807 15:11:15.949486 29566 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:15.956877 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:15.990566 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 111240us
W20260807 15:11:15.991159 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 44372.5us
W20260807 15:11:15.993582 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 164580us
I20260807 15:11:15.996992 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:15.997301 992 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.002118 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.001540 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.010394 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:15.988915 1149 log.cc:924] Time spent T 27275fe691bf4c42814ccca06801b625 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.747s user 0.006s sys 0.000s
I20260807 15:11:16.001540 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:16.020433 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.021123 29452 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:15.967021 1137 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:15.989220 1044 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:15.951331 1112 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:15.989672 821 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:16.025842 1192 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:16.010771 1182 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.026793 1116 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260807 15:11:16.033376 1191 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:16.104277 1182 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.037349 29609 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:16.106597 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 69341.3us
I20260807 15:11:16.038556 796 consensus_queue.cc:1035] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:16.039150 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:16.039752 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:16.040424 1047 consensus_queue.cc:1035] T 1fc8adcf9402487ca81d7c0edc5dd599 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 15:11:15.988956 1015 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:16.041667 1203 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:16.042315 1194 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.042936 1102 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 15:11:16.019811 29568 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:15.954548 1159 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.054322 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.062027 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:16.064385 1146 log.cc:924] Time spent T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.862s user 0.002s sys 0.000s
W20260807 15:11:16.026444 1202 log.cc:924] Time spent T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260807 15:11:16.008414 1145 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:16.001389 963 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.144363 963 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.064772 1033 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.054343 1126 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:16.059211 29531 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:16.071291 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.072628 1188 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.072734 1192 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.007587 1133 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.074709 1112 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.022814 992 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:16.078179 678 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.086386 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.368377 29637 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
I20260807 15:11:16.008796 1168 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.016601 1173 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:16.095692 29480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1026) took 1648 ms. Trace:
I20260807 15:11:16.131749 1102 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:16.099852 29608 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:16.101014 1198 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:16.102712 29449 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:16.049261 998 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260807 15:11:16.103376 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.114049 29452 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:16.376551 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 273973us
I20260807 15:11:16.377142 29449 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:16.129942 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:16.134553 1159 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.377805 29487 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
W20260807 15:11:16.390671 1109 consensus_meta.cc:287] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.537s user 0.011s sys 0.000s
I20260807 15:11:16.067368 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.112360 29647 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "9bbe5c211ab64989a57350f34f007ced"
from {username='slave'} at 127.0.0.1:40014
W20260807 15:11:16.308945 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 83469us
I20260807 15:11:16.408190 29647 raft_consensus.cc:595] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:16.408607 29647 raft_consensus.cc:603] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 15:11:16.408744 29533 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:16.325398 29567 raft_consensus.cc:1226] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
W20260807 15:11:16.341756 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 282627us
I20260807 15:11:16.120091 991 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.413681 30305 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:16.359282 29565 raft_consensus.cc:1261] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260807 15:11:16.003516 1144 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.417810 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:16.358067 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 312430us
I20260807 15:11:16.147205 1182 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.096026 1044 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.340590 1126 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:16.370404 29480 rpcz_store.cc:276] 0807 15:11:14.447537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:14.449049 (+ 1512us) service_pool.cc:227] Handling call
0807 15:11:14.452709 (+ 3660us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:15.654970 (+1202261us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:16.095348 (+440378us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001392d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:16.095609 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2697811840}
I20260807 15:11:16.346295 1123 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 15:11:16.376926 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 262959us
I20260807 15:11:16.378278 29449 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:16.483127 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 104919us
I20260807 15:11:16.124625 29646 raft_consensus.cc:3037] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Advancing to term 10
W20260807 15:11:16.378791 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 279059us
I20260807 15:11:16.121485 1191 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.243s
I20260807 15:11:16.382357 958 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:16.383203 931 consensus_queue.cc:1035] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:11:16.502856 30274 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:16.384127 815 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 15:11:16.384847 1177 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:16.385244 1134 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:16.392850 1159 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.354422 1118 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.138482 1077 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:16.400954 29484 raft_consensus.cc:1261] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 15:11:16.411461 30272 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:16.577553 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 166206us
I20260807 15:11:16.123208 1194 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.417116 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:16.129134 1015 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.418596 30308 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 10.
I20260807 15:11:16.108007 821 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:16.479316 29365 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 51805.3us
I20260807 15:11:16.562145 815 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:16.499190 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:16.500556 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 65241us
I20260807 15:11:16.355641 1188 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.512959 29608 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:16.567833 30304 raft_consensus.cc:1226] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260807 15:11:16.123063 1203 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:16.573665 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 70956.1us
I20260807 15:11:16.377687 1173 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.590571 30307 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 7: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:16.506600 1167 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 15:11:16.480927 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4fbc64c4dbd34587a70422db1adc925c, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:16.623972 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4fbc64c4dbd34587a70422db1adc925c, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.428458 991 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:16.593217 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 176693us
I20260807 15:11:16.501205 1126 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Advancing to term 10
W20260807 15:11:16.614244 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 101419us
I20260807 15:11:16.579602 1172 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:16.413177 1109 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.589473 1033 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.579247 1212 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 15:11:16.615376 1041 consensus_meta.cc:287] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.778s user 0.009s sys 0.003s
I20260807 15:11:16.640450 1038 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:16.645926 1168 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.593235 1210 raft_consensus.cc:2726] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:11:16.646533 1206 log.cc:924] Time spent T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
I20260807 15:11:16.660319 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.627090 30303 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 10: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:16.618012 815 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:16.627664 1198 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:16.585999 1118 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.662770 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:16.502200 1182 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:16.631676 1108 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.669482 29569 raft_consensus.cc:1226] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:16.646881 1075 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260807 15:11:16.672322 30304 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:16.651958 1212 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 15:11:16.683300 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 199116us
I20260807 15:11:16.634205 1178 consensus_queue.cc:1035] T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260807 15:11:16.687616 29449 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:16.668459 1198 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:16.661701 963 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.703644 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:16.705228 29449 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:16.706640 29449 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:16.653100 1080 consensus_queue.cc:1035] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260807 15:11:16.658926 1041 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.627399 1102 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.660205 1047 consensus_queue.cc:1035] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260807 15:11:16.707860 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:16.715526 29452 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:16.721442 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:16.690497 860 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.697400 1198 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:16.691648 1133 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:16.693761 1192 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.695948 678 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.692098 1212 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:16.697242 1112 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.740020 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:16.703488 1185 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:16.745901 1217 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.746546 1217 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.748404 1194 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.748907 1217 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.752329 821 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.723397 958 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:16.760177 1181 consensus_queue.cc:1035] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.102s
I20260807 15:11:16.726958 1177 raft_consensus.cc:2726] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:16.707930 992 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:16.761592 1195 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:16.730048 1044 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.694141 1108 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.762387 1195 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:16.763991 1207 log.cc:924] Time spent T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.278s user 0.001s sys 0.000s
I20260807 15:11:16.764320 1108 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.765347 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:16.766669 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:16.766446 1126 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.767220 1203 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:16.769156 1214 log.cc:924] Time spent T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260807 15:11:16.771658 1109 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.771795 29646 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 10.
I20260807 15:11:16.772465 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:16.773069 1173 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.773612 1126 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:16.778525 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:16.780865 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 65054.9us
I20260807 15:11:16.687533 1182 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.767789 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:16.789780 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.773070 29566 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:11:16.786005 1190 log.cc:924] Time spent T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
W20260807 15:11:16.786407 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 154756us
I20260807 15:11:16.790764 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:16.795758 29640 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:16.796702 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:16.797860 30307 raft_consensus.cc:2396] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260807 15:11:16.761548 1015 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.799010 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:16.799644 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:16.802249 1182 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.790386 29568 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 12.
I20260807 15:11:16.804251 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.804472 30304 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:16.808172 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:16.808719 1195 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:16.810304 29479 raft_consensus.cc:1261] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:11:16.812496 29640 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10.
I20260807 15:11:16.814002 29479 raft_consensus.cc:1226] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260807 15:11:16.821201 29378 catalog_manager.cc:5495] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced reported cstate change: config changed from index 3 to 5, term changed from 3 to 4, leader changed from fbf78964d70448269802ac7de9d7a198 (127.27.144.196) to <none>, VOTER 4b092f7f951b4137b5d7810056684270 (127.27.144.195) evicted. New cstate: current_term: 4 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:16.835408 30308 raft_consensus.cc:1226] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260807 15:11:16.726218 1123 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:16.793100 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:16.736950 1159 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:16.843652 29563 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 9.
I20260807 15:11:16.852659 30273 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:16.853880 29533 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:16.860967 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:16.872674 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:16.873169 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 157744us
I20260807 15:11:16.880927 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:16.728147 860 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.893376 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:16.906101 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 53580.7us
I20260807 15:11:16.901659 1218 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:16.866261 1182 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:16.928380 1182 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.926393 1212 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:16.939424 1118 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.875058 1133 consensus_queue.cc:1046] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260807 15:11:16.940785 1144 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:16.945657 1213 log.cc:924] Time spent T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.348s user 0.002s sys 0.000s
I20260807 15:11:16.956403 991 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.956422 1212 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.958859 1178 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260807 15:11:16.959434 1178 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:16.959910 1178 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Advancing to term 13
W20260807 15:11:16.891100 1145 consensus_meta.cc:287] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.749s user 0.013s sys 0.000s
W20260807 15:11:16.969825 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 59523.9us
W20260807 15:11:16.974288 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 330116us
I20260807 15:11:16.888926 1217 raft_consensus.cc:2781] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:11:16.986080 30308 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:16.999265 29531 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:16.991525 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:16.986667 1159 consensus_queue.cc:1046] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260807 15:11:16.993779 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:17.010017 30310 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:17.006633 1188 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:16.789589 1185 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.857311 1123 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:16.905465 1109 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:17.041985 29561 raft_consensus.cc:2396] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260807 15:11:17.057246 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:17.075685 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:17.079200 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:17.019788 1137 consensus_meta.cc:287] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.953s user 0.005s sys 0.005s
I20260807 15:11:17.084915 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:16.981446 1182 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.104341 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3350) took 1236 ms. Trace:
I20260807 15:11:17.023612 1208 raft_consensus.cc:2781] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader election won for term 10
I20260807 15:11:16.994290 1044 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:16.994035 1033 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:17.103654 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 46498.4us
I20260807 15:11:17.041297 1212 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.083060 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:17.046965 1144 raft_consensus.cc:3032] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:17.129571 1144 raft_consensus.cc:729] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:17.130828 1144 consensus_queue.cc:260] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.132570 1144 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:17.086614 1124 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.135871 1124 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.114988 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:17.116230 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:17.103096 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:17.084725 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:17.124159 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:17.106665 29560 rpcz_store.cc:276] 0807 15:11:15.844586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:15.844799 (+ 213us) service_pool.cc:227] Handling call
0807 15:11:15.906328 (+ 61529us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:15.906764 (+ 436us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:15.906800 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:15.998750 (+ 91950us) log.cc:842] Serialized 26 byte log entry
0807 15:11:16.365353 (+366603us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:16.365379 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:16.365431 (+ 52us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:16.944964 (+579533us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:11:17.057920 (+112956us) raft_consensus.cc:1671] finished
0807 15:11:17.057949 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:17.081322 (+ 23373us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":15782,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":40027,"spinlock_wait_cycles":22379904,"thread_start_us":321142,"threads_started":1,"wal-append.queue_time_us":420851}
I20260807 15:11:17.073225 1217 raft_consensus.cc:686] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:17.085717 1141 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:17.141959 29637 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:17.156072 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:17.103353 1138 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.115792 1189 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.162555 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:17.180524 29645 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:17.104401 821 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.144307 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:17.024282 815 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.157723 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:17.173218 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 44810.6us
I20260807 15:11:17.157130 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:17.185031 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:17.140304 1208 raft_consensus.cc:686] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [term 10 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:17.248145 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:17.265010 29637 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:17.250339 29449 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:17.287781 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:17.289531 29484 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s user 0.038s sys 0.095s
W20260807 15:11:17.291688 29484 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s user 0.039s sys 0.095s
I20260807 15:11:17.252092 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:17.255505 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:17.317270 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 63850.7us
I20260807 15:11:17.105705 1137 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.172726 1041 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.127698 1044 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:17.139496 1033 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:17.391487 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:17.181645 1225 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:17.405649 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 155431us
I20260807 15:11:17.406695 29449 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:17.408411 29449 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:17.409139 30312 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
W20260807 15:11:17.410996 29378 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.506s user 0.001s sys 0.007s
I20260807 15:11:17.161538 1212 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:17.442508 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:17.444012 29560 raft_consensus.cc:2379] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:11:17.452333 30306 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s user 0.000s sys 0.024s
W20260807 15:11:17.452958 30306 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.656s user 0.000s sys 0.025s
I20260807 15:11:17.182492 993 consensus_queue.cc:1046] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.211s
I20260807 15:11:17.182783 1075 consensus_queue.cc:1046] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.222s
I20260807 15:11:17.184610 931 consensus_queue.cc:1035] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.208s
I20260807 15:11:17.468819 29645 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:17.242393 1077 consensus_queue.cc:1046] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.199s
I20260807 15:11:17.404208 1159 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:17.494184 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 175923us
I20260807 15:11:17.443408 1174 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:11:17.385427 1142 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:17.501363 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 251276us
I20260807 15:11:17.405193 1145 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:17.186419 1138 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.244335 821 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:17.509608 1124 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:17.177785 1141 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.452378 958 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader election won for term 10
I20260807 15:11:17.455648 1112 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:17.424687 1109 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.244494 1189 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:17.491403 29637 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10.
W20260807 15:11:17.515542 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 107255us
I20260807 15:11:17.602712 29449 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:17.510079 1134 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:17.517580 1230 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:17.607478 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 50586.8us
I20260807 15:11:17.543699 860 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.521083 1118 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.444082 1217 consensus_queue.cc:237] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.559011 991 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:17.566759 1218 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:17.577070 1168 raft_consensus.cc:3032] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:17.613611 1109 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:17.615211 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 70627.8us
I20260807 15:11:17.547214 998 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:17.626138 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:17.712237 29563 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:17.592409 1195 raft_consensus.cc:3032] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:17.552563 1159 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.608970 1124 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.607478 1185 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:17.746582 30310 consensus_meta.cc:287] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.736s user 0.010s sys 0.005s
I20260807 15:11:17.747400 30310 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10.
I20260807 15:11:17.625664 993 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:17.589502 1142 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.742614 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:17.766167 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2358) took 1350 ms. Trace:
W20260807 15:11:17.628772 1198 consensus_meta.cc:287] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.853s user 0.008s sys 0.004s
I20260807 15:11:17.608573 796 raft_consensus.cc:3032] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:17.749523 1195 raft_consensus.cc:729] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:17.646266 1167 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 15:11:17.679380 29566 consensus_meta.cc:287] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.884s user 0.008s sys 0.003s
I20260807 15:11:17.768092 30273 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:17.771099 29565 rpcz_store.cc:276] 0807 15:11:16.415366 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.416773 (+ 1407us) service_pool.cc:227] Handling call
0807 15:11:16.417066 (+ 293us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:16.630898 (+213832us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.630933 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:16.630973 (+ 40us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:16.631003 (+ 30us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:17.765824 (+1134821us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54000988d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:17.765894 (+ 70us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:17.766086 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":491295616}
I20260807 15:11:17.645946 1123 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:17.642472 1168 raft_consensus.cc:729] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:17.774397 1133 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:11:17.643774 1227 log.cc:924] Time spent T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.050s user 0.001s sys 0.000s
I20260807 15:11:17.611267 1134 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.711462 1077 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:17.761193 1224 log.cc:924] Time spent T 18498fa007b248e9af1c1eaeee728541 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.318s user 0.000s sys 0.002s
I20260807 15:11:17.799255 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:17.610984 1112 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.779724 796 raft_consensus.cc:729] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:17.746785 815 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:17.818416 860 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:17.763801 998 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.782089 993 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.726257 1126 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:17.852790 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:17.796057 1137 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.817826 958 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:17.638320 1118 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:17.781518 1247 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:17.796685 1182 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:17.894493 30310 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:17.796321 29566 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 7.
I20260807 15:11:17.892264 1123 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:17.861805 1138 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.924088 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1088) took 1167 ms. Trace:
I20260807 15:11:17.833321 1044 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.852262 1033 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.782534 1124 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:17.466583 1225 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.870405 860 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:17.924579 29566 rpcz_store.cc:276] 0807 15:11:16.744432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.772242 (+ 27810us) service_pool.cc:227] Handling call
0807 15:11:17.912227 (+1139985us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:17.790144 1198 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.942016 1123 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.924677 1141 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:17.946614 1240 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.169s user 0.000s sys 0.001s
W20260807 15:11:17.954819 30311 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.594s user 0.010s sys 0.012s
I20260807 15:11:17.855544 1133 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.006282 29642 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:17.958328 1044 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:17.997994 30310 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 11.
I20260807 15:11:17.898455 1109 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.961738 1033 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:17.997991 30311 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.637s user 0.010s sys 0.012s
W20260807 15:11:17.966861 1232 log.cc:924] Time spent T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.399s user 0.001s sys 0.001s
I20260807 15:11:17.925339 1182 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:17.971789 1228 log.cc:924] Time spent T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.411s user 0.002s sys 0.000s
W20260807 15:11:17.996878 1235 log.cc:924] Time spent T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.411s user 0.000s sys 0.002s
I20260807 15:11:17.965785 860 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:11:18.028159 29568 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s user 0.005s sys 0.011s
W20260807 15:11:18.031430 29570 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.894s user 0.013s sys 0.001s
I20260807 15:11:17.920858 1126 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:18.035851 29568 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s user 0.005s sys 0.011s
W20260807 15:11:18.036787 29570 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s user 0.013s sys 0.001s
I20260807 15:11:17.560174 1208 consensus_queue.cc:237] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.899578 1195 consensus_queue.cc:260] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:17.857125 1077 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.999650 821 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:17.912688 1168 consensus_queue.cc:260] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.017586 1138 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:17.626547 1230 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.647119 1218 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:17.958485 796 consensus_queue.cc:260] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:17.921530 1247 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.270378 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3196) took 1849 ms. Trace:
I20260807 15:11:18.235704 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3378) took 1069 ms. Trace:
I20260807 15:11:18.377264 29561 rpcz_store.cc:276] 0807 15:11:17.166713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:17.542349 (+375636us) service_pool.cc:227] Handling call
0807 15:11:17.542676 (+ 327us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:17.654212 (+111536us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:17.654262 (+ 50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:17.654336 (+ 74us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:17.654394 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.235367 (+580973us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002ce2d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.235441 (+ 74us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.235626 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":255823744}
I20260807 15:11:18.378289 1230 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:18.346381 29642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35570 (request call id 891) took 1640 ms (client timeout 2023 ms). Trace:
I20260807 15:11:18.275104 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3377) took 1127 ms. Trace:
I20260807 15:11:18.233219 30309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54176 (request call id 21) took 2209 ms. Trace:
I20260807 15:11:18.034724 1033 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.029026 1044 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.376577 1168 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:18.390005 1033 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.378394 1218 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.390426 1044 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.180745 29485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3180) took 2650 ms. Trace:
I20260807 15:11:18.390856 29560 rpcz_store.cc:276] 0807 15:11:17.148182 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:17.516991 (+368809us) service_pool.cc:227] Handling call
0807 15:11:17.555129 (+ 38138us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:17.612940 (+ 57811us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:17.613011 (+ 71us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:17.613123 (+ 112us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:17.613201 (+ 78us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.274854 (+661653us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b540014d054. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.274915 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.275039 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":131752832}
I20260807 15:11:18.274840 1212 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:18.346828 29531 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.195:33653 timed out after 1.630s (SENT) [suppressed 1 similar messages]
W20260807 15:11:18.104815 1251 log.cc:924] Time spent T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.156s user 0.001s sys 0.000s
I20260807 15:11:18.153645 29480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3197) took 1732 ms. Trace:
I20260807 15:11:18.344555 1159 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.185642 1112 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.381137 1195 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:18.393847 29480 rpcz_store.cc:276] 0807 15:11:16.421485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.429278 (+ 7793us) service_pool.cc:227] Handling call
0807 15:11:16.506106 (+ 76828us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:16.558774 (+ 52668us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 15:11:16.687093 (+128319us) log.cc:842] Serialized 14 byte log entry
0807 15:11:16.688381 (+ 1288us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:16.688458 (+ 77us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:16.688520 (+ 62us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.153346 (+1464826us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b54003acfd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.153411 (+ 65us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.153566 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14617,"prepare.queue_time_us":201515,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":922,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11910,"spinlock_wait_cycles":120478976,"thread_start_us":109542,"threads_started":1}
I20260807 15:11:18.245504 1123 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.249842 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1047) took 2205 ms. Trace:
I20260807 15:11:18.069389 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3191) took 1671 ms. Trace:
I20260807 15:11:18.396261 29482 rpcz_store.cc:276] 0807 15:11:16.044427 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.044553 (+ 126us) service_pool.cc:227] Handling call
0807 15:11:16.061364 (+ 16811us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:16.371208 (+309844us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 15:11:16.634685 (+263477us) log.cc:842] Serialized 14 byte log entry
0807 15:11:17.139683 (+504998us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:17.139759 (+ 76us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:17.139834 (+ 75us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.249497 (+1109663us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54000f82d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.249569 (+ 72us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.249755 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":84718,"prepare.queue_time_us":357043,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":15410,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13616,"spinlock_wait_cycles":711934208,"thread_start_us":737539,"threads_started":2,"wal-append.queue_time_us":816788}
I20260807 15:11:18.396405 29487 rpcz_store.cc:276] 0807 15:11:16.398327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.398534 (+ 207us) service_pool.cc:227] Handling call
0807 15:11:16.419915 (+ 21381us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:16.420326 (+ 411us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.420365 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:16.569355 (+148990us) log.cc:842] Serialized 26 byte log entry
0807 15:11:16.864405 (+295050us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:16.882572 (+ 18167us) log.cc:842] Serialized 14 byte log entry
0807 15:11:16.903277 (+ 20705us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:16.903370 (+ 93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:18.069024 (+1165654us) raft_consensus.cc:1671] finished
0807 15:11:18.069056 (+ 32us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.069254 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35177,"prepare.queue_time_us":23677,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":29840,"raft.queue_time_us":32727,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":95674,"thread_start_us":242713,"threads_started":1,"wal-append.queue_time_us":568467}
I20260807 15:11:18.398500 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:18.168919 1142 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.398823 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:11:18.393332 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 46539.5us
W20260807 15:11:18.180576 1250 log.cc:924] Time spent T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.369s user 0.000s sys 0.002s
I20260807 15:11:18.239655 1118 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.269659 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3176) took 2745 ms. Trace:
I20260807 15:11:18.382266 1138 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.383431 1077 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.244442 998 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:18.234822 1252 log.cc:924] Time spent T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.344s user 0.002s sys 0.000s
I20260807 15:11:18.187099 1126 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.036875 958 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:18.230199 1233 log.cc:924] Time spent T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.579s user 0.000s sys 0.003s
I20260807 15:11:18.333228 1145 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.336926 993 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.190351 1182 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.150987 1225 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:18.165011 1241 log.cc:924] Time spent T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.134s user 0.000s sys 0.001s
I20260807 15:11:18.232686 1133 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:18.278779 1154 raft_consensus.cc:3032] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
W20260807 15:11:18.388166 29642 rpcz_store.cc:269] 0807 15:11:16.706187 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.707475 (+ 1288us) service_pool.cc:227] Handling call
0807 15:11:18.346029 (+1638554us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400360454. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:18.346250 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2948334464}
I20260807 15:11:18.375927 29486 rpcz_store.cc:276] 0807 15:11:16.421129 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.421283 (+ 154us) service_pool.cc:227] Handling call
0807 15:11:16.421521 (+ 238us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:16.599868 (+178347us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.599941 (+ 73us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:16.600577 (+ 636us) log.cc:842] Serialized 26 byte log entry
0807 15:11:17.053688 (+453111us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:17.136844 (+ 83156us) log.cc:842] Serialized 14 byte log entry
0807 15:11:17.139141 (+ 2297us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.269522 (+1130381us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000d2354. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.269618 (+ 96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:18.269703 (+ 85us) raft_consensus.cc:1671] finished
0807 15:11:18.270063 (+ 360us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.270293 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":127241,"prepare.queue_time_us":95358,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":4466,"raft.queue_time_us":27236,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":24607,"spinlock_wait_cycles":387097216,"thread_start_us":371814,"threads_started":1,"wal-append.queue_time_us":828100}
I20260807 15:11:18.273696 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:33668 (request call id 774) took 1630 ms. Trace:
I20260807 15:11:18.231460 30305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1535) took 1744 ms. Trace:
W20260807 15:11:18.151257 30303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48584 (request call id 802) took 2390 ms (client timeout 1963 ms). Trace:
I20260807 15:11:18.392583 30309 rpcz_store.cc:276] 0807 15:11:16.023612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.023828 (+ 216us) service_pool.cc:227] Handling call
0807 15:11:18.232740 (+2208912us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b540073d054. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdca7c5 00007f94dbdc2c1a 00007f94e0d066d9 00007f94da3f0184 00007f94da3f0112 00007f94da3f0041 00007f94da3effbc 00007f94da3ef272 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.233068 (+ 328us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":803451776}
I20260807 15:11:18.186071 1134 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.399576 29487 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:18.433950 1253 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.392119 29485 rpcz_store.cc:276] 0807 15:11:15.530702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:15.530844 (+ 142us) service_pool.cc:227] Handling call
0807 15:11:15.531167 (+ 323us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:16.754715 (+1223548us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b1800396fa0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94dba5382c 00007f94d8e7e9dc 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e99155 00007f94dbdbc3d0 00007f94dbdbcf6b 00007f94dbdc778b
0807 15:11:16.770138 (+ 15423us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.770173 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:16.770610 (+ 437us) log.cc:842] Serialized 26 byte log entry
0807 15:11:17.114032 (+343422us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:11:17.114093 (+ 61us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:17.114180 (+ 87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:18.180306 (+1066126us) raft_consensus.cc:1671] finished
0807 15:11:18.180330 (+ 24us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.180665 (+ 335us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":27078,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":21425,"spinlock_wait_cycles":4696320,"thread_start_us":401876,"threads_started":2,"wal-append.queue_time_us":704558}
I20260807 15:11:18.402050 29488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3195) took 1986 ms. Trace:
I20260807 15:11:18.402280 29481 rpcz_store.cc:276] 0807 15:11:15.524126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:15.524298 (+ 172us) service_pool.cc:227] Handling call
0807 15:11:15.524613 (+ 315us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:15.612050 (+ 87437us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:15.612097 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:15.612157 (+ 60us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:15.612214 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.269286 (+2657072us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b54001833d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.269363 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.269570 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":200434560}
W20260807 15:11:18.440254 29533 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.666s user 0.046s sys 0.039s
I20260807 15:11:18.191746 1124 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:18.458633 1178 consensus_meta.cc:287] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 1.498s user 0.013s sys 0.004s
W20260807 15:11:18.443269 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 259570us
I20260807 15:11:18.239037 1198 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:18.242920 1144 consensus_meta.cc:287] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 1.110s user 0.010s sys 0.005s
I20260807 15:11:18.448765 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.524065 29480 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
W20260807 15:11:18.524622 29480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2360) took 1451 ms (client timeout 1576 ms). Trace:
W20260807 15:11:18.524978 29480 rpcz_store.cc:269] 0807 15:11:17.073705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.421320 (+1347615us) service_pool.cc:227] Handling call
0807 15:11:18.524562 (+103242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.432571 1185 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:18.453449 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 145336us
I20260807 15:11:18.507799 29488 rpcz_store.cc:276] 0807 15:11:16.416079 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.416193 (+ 114us) service_pool.cc:227] Handling call
0807 15:11:16.506335 (+ 90142us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:16.652115 (+145780us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.652155 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:16.669007 (+ 16852us) log.cc:842] Serialized 26 byte log entry
0807 15:11:17.044931 (+375924us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:17.107256 (+ 62325us) log.cc:842] Serialized 14 byte log entry
0807 15:11:17.122438 (+ 15182us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.348357 (+1225919us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540009ef54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.348432 (+ 75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:18.348502 (+ 70us) raft_consensus.cc:1671] finished
0807 15:11:18.401709 (+ 53207us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.401957 (+ 248us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18398,"prepare.queue_time_us":100370,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":3194,"raft.queue_time_us":47648,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":24375,"spinlock_wait_cycles":302090368,"thread_start_us":342673,"threads_started":1,"wal-append.queue_time_us":715431}
W20260807 15:11:18.457701 1229 log.cc:924] Time spent T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.669s user 0.004s sys 0.001s
I20260807 15:11:18.459831 29479 rpcz_store.cc:276] 0807 15:11:16.643470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.815512 (+172042us) service_pool.cc:227] Handling call
0807 15:11:18.272642 (+1457130us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54000d2354. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49af0 00007f94dbdccf2a 00007f94e0d09c6e 00007f94da400807 00007f94da400792 00007f94da4006c1 00007f94da40063c 00007f94da3ff8f2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:18.273508 (+ 866us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":743200512}
I20260807 15:11:18.540406 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.444761 1145 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:18.459977 30305 rpcz_store.cc:276] 0807 15:11:16.486697 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.486861 (+ 164us) service_pool.cc:227] Handling call
0807 15:11:16.562121 (+ 75260us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:16.649054 (+ 86933us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.649098 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:16.649155 (+ 57us) raft_consensus.cc:1631] Marking committed up to 11
0807 15:11:16.649200 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.231058 (+1581858us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54006c11d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.231133 (+ 75us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.231331 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":199313280}
W20260807 15:11:18.465775 29367 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fbf78964d70448269802ac7de9d7a198 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:18.508983 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:18.547367 29367 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 81676.9us
W20260807 15:11:18.509400 29533 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.735s user 0.047s sys 0.039s
W20260807 15:11:18.441046 29449 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.796s user 0.003s sys 0.010s
I20260807 15:11:18.514293 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:18.548332 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 799931us
I20260807 15:11:18.533955 1253 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:18.549017 29481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1053) took 1545 ms (client timeout 1948 ms). Trace:
W20260807 15:11:18.549616 29481 rpcz_store.cc:269] 0807 15:11:17.004057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.513973 (+1509916us) service_pool.cc:227] Handling call
0807 15:11:18.548932 (+ 34959us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.550824 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.551303 1253 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.552316 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.553680 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.554556 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 3203) took 1375 ms. Trace:
I20260807 15:11:18.554961 29481 rpcz_store.cc:276] 0807 15:11:17.179377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.553414 (+1374037us) service_pool.cc:227] Handling call
0807 15:11:18.554500 (+ 1086us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.451660 1189 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:11:18.521714 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:18.522464 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:18.513543 1257 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:18.555852 30273 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:18.556509 1257 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.558213 29481 raft_consensus.cc:1261] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260807 15:11:18.461025 30303 rpcz_store.cc:269] 0807 15:11:15.760591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:15.760762 (+ 171us) service_pool.cc:227] Handling call
0807 15:11:18.150689 (+2389927us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54008403d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:18.151037 (+ 348us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1840923008}
I20260807 15:11:18.558970 1257 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.559777 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:18.560617 30303 raft_consensus.cc:2454] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:18.555047 1144 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:18.562000 1144 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.556313 30309 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 7: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:18.459794 1154 raft_consensus.cc:729] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:18.565289 1154 consensus_queue.cc:260] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.566958 1154 raft_consensus.cc:3037] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:18.568325 1225 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:11:18.569068 1225 raft_consensus.cc:686] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [term 7 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:18.570171 1225 consensus_queue.cc:237] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.573310 1144 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:11:18.558704 29449 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.914s user 0.003s sys 0.010s
W20260807 15:11:18.580392 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 968063us
I20260807 15:11:18.581524 29449 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:18.393352 1247 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:18.586059 1258 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.586781 1258 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.589520 1258 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.547155 1185 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.592861 1185 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:18.593701 29486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2358) took 1731 ms (client timeout 1939 ms). Trace:
W20260807 15:11:18.594058 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 64214.8us
W20260807 15:11:18.594218 29486 rpcz_store.cc:269] 0807 15:11:16.862530 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.462957 (+1600427us) service_pool.cc:227] Handling call
0807 15:11:18.593624 (+130667us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.511831 1218 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.596297 1218 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.598692 1218 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.601771 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3371) took 1600 ms. Trace:
W20260807 15:11:18.602006 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 1fc8adcf9402487ca81d7c0edc5dd599, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:18.603279 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 1fc8adcf9402487ca81d7c0edc5dd599, TS 4b092f7f951b4137b5d7810056684270 -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.595484 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.532164 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:18.604599 29486 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:18.604909 29485 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:18.512066 1133 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:18.620652 1133 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.621331 1038 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:18.621985 1038 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.623003 1133 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.624285 1138 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.546299 1175 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:18.624788 29533 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:18.625443 1124 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.625396 1175 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.626076 29533 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:18.626374 1182 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.626926 1182 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.628104 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2359) took 1554 ms. Trace:
I20260807 15:11:18.628191 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1087) took 1884 ms. Trace:
I20260807 15:11:18.628393 821 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.602257 29568 rpcz_store.cc:276] 0807 15:11:17.001301 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:17.025040 (+ 23739us) service_pool.cc:227] Handling call
0807 15:11:17.025486 (+ 446us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:17.075610 (+ 50124us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:17.075654 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:17.103032 (+ 27378us) log.cc:842] Serialized 26 byte log entry
0807 15:11:18.042734 (+939702us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:18.042786 (+ 52us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.042882 (+ 96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:18.601504 (+558622us) raft_consensus.cc:1671] finished
0807 15:11:18.601531 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.601697 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61173,"raft.queue_time_us":49739,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":27618,"thread_start_us":870259,"threads_started":1,"wal-append.queue_time_us":1465615}
I20260807 15:11:18.629142 1182 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:18.629468 860 consensus_meta.cc:287] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.560s user 0.010s sys 0.001s
I20260807 15:11:18.629045 821 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.629833 1182 raft_consensus.cc:2781] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:18.632985 1182 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.633409 1182 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:18.606321 29561 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:18.615653 1253 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.636229 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:18.616191 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.636512 30310 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 4.
I20260807 15:11:18.616369 1189 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
W20260807 15:11:18.617174 29607 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.193s user 0.001s sys 0.014s
W20260807 15:11:18.640774 29607 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.394s user 0.001s sys 0.015s
I20260807 15:11:18.641084 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:18.531159 1142 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:18.651595 1257 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.652348 1142 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.652654 1257 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.653450 1173 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:18.654194 1173 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.524842 1178 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.522464 1167 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.629896 860 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.630753 1245 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:18.630904 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:18.631822 1118 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.730048 29488 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 10: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:11:18.730525 29488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1052) took 1727 ms (client timeout 2193 ms). Trace:
W20260807 15:11:18.730846 29488 rpcz_store.cc:269] 0807 15:11:17.003548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.530086 (+1526538us) service_pool.cc:227] Handling call
0807 15:11:18.730470 (+200384us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.626133 1124 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.608302 29484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3198) took 1974 ms. Trace:
I20260807 15:11:18.637641 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:18.628564 29479 rpcz_store.cc:276] 0807 15:11:17.073423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.539987 (+1466564us) service_pool.cc:227] Handling call
0807 15:11:18.628043 (+ 88056us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.733752 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.732540 29484 rpcz_store.cc:276] 0807 15:11:16.633620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.633776 (+ 156us) service_pool.cc:227] Handling call
0807 15:11:16.634107 (+ 331us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:16.659417 (+ 25310us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.659453 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:16.672961 (+ 13508us) log.cc:842] Serialized 26 byte log entry
0807 15:11:16.934150 (+261189us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b4800120258. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e0c6b7f1 00007f94e0c628e7 00007f94e0c6277a 00007f94e0d5695f 00007f94e0d56627 00007f94e0d6ab2c 00007f94e0d6aad8 00007f94e0d6aa58 00007f94e0d6aa13 00007f94e0d69cbc 00007f94dfcebbe6
0807 15:11:17.294143 (+359993us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:17.371652 (+ 77509us) log.cc:842] Serialized 14 byte log entry
0807 15:11:17.466541 (+ 94889us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:17.466670 (+ 129us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:18.413324 (+946654us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:11:18.608088 (+194764us) raft_consensus.cc:1671] finished
0807 15:11:18.608109 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.608234 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":200097,"prepare.queue_time_us":94080,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":120718,"raft.run_cpu_time_us":2779,"raft.run_wall_time_us":298883,"spinlock_wait_cycles":26579584,"thread_start_us":587357,"threads_started":1,"wal-append.queue_time_us":958143}
I20260807 15:11:18.734596 29479 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:18.735124 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.735831 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.735764 29484 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:18.608698 29481 pending_rounds.cc:76] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: Aborting all ops after (but not including) 5
I20260807 15:11:18.737257 29481 pending_rounds.cc:97] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260807 15:11:18.737600 29481 raft_consensus.cc:2866] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:11:18.738459 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1049) took 1827 ms. Trace:
I20260807 15:11:18.738885 29481 rpcz_store.cc:276] 0807 15:11:16.911478 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.556665 (+1645187us) service_pool.cc:227] Handling call
0807 15:11:18.557872 (+ 1207us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:18.738131 (+180259us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.738391 (+ 260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.628705 29564 rpcz_store.cc:276] 0807 15:11:16.744093 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.787481 (+ 43388us) service_pool.cc:227] Handling call
0807 15:11:16.864985 (+ 77504us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:16.879391 (+ 14406us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.879435 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:16.880254 (+ 819us) log.cc:842] Serialized 26 byte log entry
0807 15:11:17.446897 (+566643us) raft_consensus.cc:1631] Marking committed up to 9
0807 15:11:17.446944 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:17.447125 (+ 181us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:18.627966 (+1180841us) raft_consensus.cc:1671] finished
0807 15:11:18.627987 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.628130 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19390,"raft.queue_time_us":14656,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":13380,"thread_start_us":475874,"threads_started":1,"wal-append.queue_time_us":1006276}
I20260807 15:11:18.631578 821 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.627789 1043 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:18.646791 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.646888 1253 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.646776 1189 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.650223 29531 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:18.641770 29561 raft_consensus.cc:2454] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:18.704845 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.679273 29487 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:18.763363 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:18.763474 29486 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:18.762888 30304 raft_consensus.cc:1226] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 13 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 12. Current term is 13. Ops: []
I20260807 15:11:18.722114 29645 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:18.764721 29645 raft_consensus.cc:595] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:18.724391 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.764967 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3354) took 2900 ms. Trace:
W20260807 15:11:18.725967 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 87148.7us
I20260807 15:11:18.627768 1175 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.728025 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.727950 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.740736 29485 raft_consensus.cc:2454] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:18.740115 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.753235 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.754221 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.765551 29567 rpcz_store.cc:276] 0807 15:11:15.857374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:15.859510 (+ 2136us) service_pool.cc:227] Handling call
0807 15:11:15.859858 (+ 348us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:16.413886 (+554028us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.757891 (+2344005us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400242554. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.758070 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1061025664}
W20260807 15:11:18.771615 29485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2357) took 1934 ms (client timeout 2246 ms). Trace:
I20260807 15:11:18.755239 1178 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 13 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.736720 29479 raft_consensus.cc:2454] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:18.608135 1247 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:18.664979 1133 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:18.761593 29565 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.901s user 0.008s sys 0.018s
W20260807 15:11:18.763509 29487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2361) took 1689 ms (client timeout 1681 ms). Trace:
W20260807 15:11:18.797539 29565 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s user 0.008s sys 0.018s
W20260807 15:11:18.797592 29487 rpcz_store.cc:269] 0807 15:11:17.074011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.398502 (+1324491us) service_pool.cc:227] Handling call
0807 15:11:18.763442 (+364940us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.798444 29533 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:18.798730 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:18.710816 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 129417us
I20260807 15:11:18.717617 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:18.767283 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 117181us
I20260807 15:11:18.768544 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.768874 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.802889 29484 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:18.802987 29531 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:18.771231 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.772238 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:18.760609 1174 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:18.806767 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.807478 29482 raft_consensus.cc:2396] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260807 15:11:18.807629 29642 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 10: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:18.799342 29487 raft_consensus.cc:2454] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:18.705063 1141 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:18.704082 1167 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:18.774151 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.671648 1258 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:18.761444 1238 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s user 0.013s sys 0.013s
I20260807 15:11:18.778453 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.782675 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:18.784945 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:18.778378 1038 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.709342 1245 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:18.791083 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.709951 1142 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:18.796530 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.794260 29450 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:18.769205 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.804538 29567 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:11:18.756421 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:18.772001 29485 rpcz_store.cc:269] 0807 15:11:16.837160 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.510691 (+1673531us) service_pool.cc:227] Handling call
0807 15:11:18.771555 (+260864us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.809069 29566 raft_consensus.cc:2396] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260807 15:11:18.812414 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.811529 29531 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:18.814391 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2367) took 1443 ms. Trace:
I20260807 15:11:18.814956 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.815558 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:11:18.815960 30275 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.427s user 0.012s sys 0.020s
I20260807 15:11:18.778723 1126 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:18.844740 29480 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:18.845122 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.759984 1118 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:18.932060 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 120629us
W20260807 15:11:18.935292 30275 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.546s user 0.017s sys 0.021s
I20260807 15:11:18.935407 29531 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:18.926365 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:18.938228 29481 raft_consensus.cc:2454] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:18.938690 29487 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:18.926635 29565 rpcz_store.cc:276] 0807 15:11:17.375458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:17.840973 (+465515us) service_pool.cc:227] Handling call
0807 15:11:17.841400 (+ 427us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:17.841656 (+ 256us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 15:11:17.860487 (+ 18831us) log.cc:842] Serialized 14 byte log entry
0807 15:11:18.809398 (+948911us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:18.809471 (+ 73us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:18.809538 (+ 67us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.809631 (+ 93us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.814326 (+ 4695us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11101,"prepare.queue_time_us":84464,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3295,"raft.queue_time_us":13296,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11907,"thread_start_us":937300,"threads_started":1}
I20260807 15:11:18.940442 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1056) took 1935 ms. Trace:
I20260807 15:11:18.928009 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1051) took 1924 ms. Trace:
I20260807 15:11:18.926151 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:18.926098 29484 raft_consensus.cc:2454] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:18.941298 29479 rpcz_store.cc:276] 0807 15:11:17.003239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.927199 (+1923960us) service_pool.cc:227] Handling call
0807 15:11:18.927502 (+ 303us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:18.927674 (+ 172us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:18.927698 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:18.927735 (+ 37us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:18.927783 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.927831 (+ 48us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.927954 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.941555 29567 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Advancing to term 11
I20260807 15:11:18.940467 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2362) took 1854 ms. Trace:
I20260807 15:11:18.943172 29487 rpcz_store.cc:276] 0807 15:11:17.086379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.939515 (+1853136us) service_pool.cc:227] Handling call
0807 15:11:18.939863 (+ 348us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:18.940084 (+ 221us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:18.940122 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:18.940177 (+ 55us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:18.940220 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.940283 (+ 63us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.940402 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.834954 29609 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:18.944981 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3204) took 1688 ms. Trace:
I20260807 15:11:18.945577 29487 rpcz_store.cc:276] 0807 15:11:17.256702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.944153 (+1687451us) service_pool.cc:227] Handling call
0807 15:11:18.944466 (+ 313us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:18.944640 (+ 174us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:18.944671 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:18.944718 (+ 47us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:18.944753 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.944817 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.944932 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:18.930624 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 136477us
I20260807 15:11:18.941735 29481 rpcz_store.cc:276] 0807 15:11:17.004942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.938993 (+1934051us) service_pool.cc:227] Handling call
0807 15:11:18.939346 (+ 353us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:18.940092 (+ 746us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:18.940120 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:18.940160 (+ 40us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:18.940189 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.940257 (+ 68us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.940383 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:18.950464 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:18.951166 29561 raft_consensus.cc:2454] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:11:18.952409 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:18.812534 1031 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:18.769279 1043 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.829771 998 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:18.958516 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
W20260807 15:11:18.925426 1238 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s user 0.016s sys 0.021s
I20260807 15:11:18.830060 1078 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:18.962848 29484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1057) took 1834 ms. Trace:
I20260807 15:11:18.972292 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.828799 1257 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:18.964962 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 130083us
W20260807 15:11:18.948338 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 411959us
W20260807 15:11:18.948640 1217 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s user 0.012s sys 0.015s
I20260807 15:11:18.971827 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:18.968432 1031 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:18.972492 29484 rpcz_store.cc:276] 0807 15:11:17.128127 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.957767 (+1829640us) service_pool.cc:227] Handling call
0807 15:11:18.962344 (+ 4577us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:18.962541 (+ 197us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:18.962565 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:18.962604 (+ 39us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:18.962632 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.962682 (+ 50us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.962791 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:19.249001 860 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:18.960994 1230 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:19.192242 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:18.948141 1102 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s user 0.012s sys 0.013s
I20260807 15:11:18.961576 1126 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.214576 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.187986 1123 raft_consensus.cc:2781] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 15:11:19.200320 1225 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s user 0.017s sys 0.037s
W20260807 15:11:19.448911 1225 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s user 0.020s sys 0.037s
I20260807 15:11:18.947652 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3205) took 1627 ms. Trace:
I20260807 15:11:19.298308 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.122257 1264 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:18.819119 1174 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.050457 998 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.074765 1040 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:11:19.180939 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.184114 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.219790 1178 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
W20260807 15:11:18.964143 1208 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s user 0.004s sys 0.024s
I20260807 15:11:19.049551 30312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 1021) took 2565 ms. Trace:
I20260807 15:11:19.214340 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:18.975348 1175 raft_consensus.cc:2726] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:18.813511 1133 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.072655 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.806434 1247 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.057668 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.052208 30309 raft_consensus.cc:1226] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260807 15:11:19.490950 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 436157us
I20260807 15:11:18.950814 1112 raft_consensus.cc:2726] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 15:11:18.954295 1173 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:19.094220 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:18.975651 29565 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 7: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
W20260807 15:11:19.258870 30311 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.706s user 0.028s sys 0.029s
W20260807 15:11:19.682559 30311 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.130s user 0.030s sys 0.030s
I20260807 15:11:19.121918 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.048472 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:19.275434 29369 thread.cc:602] dir /tmp/dist-test-taskv2tJJQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786115287678881-28227-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent starting thread: real 0.509s user 0.006s sys 0.010s
W20260807 15:11:18.950814 1170 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.601s user 0.080s sys 0.141s
I20260807 15:11:18.833655 1168 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:19.181028 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:18.930181 1245 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:18.843143 1258 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:19.325044 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:19.717813 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.327524 1256 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260807 15:11:19.364355 1182 consensus_meta.cc:287] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.730s user 0.020s sys 0.002s
I20260807 15:11:19.366608 1043 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:19.297134 1189 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:19.367694 1145 consensus_meta.cc:287] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.781s user 0.019s sys 0.009s
I20260807 15:11:19.316651 1253 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:19.319052 1217 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s user 0.012s sys 0.015s
I20260807 15:11:19.377295 1118 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:19.379576 1167 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:19.327792 1262 log.cc:924] Time spent T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.571s user 0.000s sys 0.002s
I20260807 15:11:19.383770 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:19.796309 29564 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
W20260807 15:11:19.411578 29482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1050) took 2408 ms (client timeout 1688 ms). Trace:
W20260807 15:11:19.797770 29482 rpcz_store.cc:269] 0807 15:11:17.002879 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.398186 (+1395307us) service_pool.cc:227] Handling call
0807 15:11:19.411309 (+1013123us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000d2854. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:19.411475 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":915412352}
I20260807 15:11:19.414217 30304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 1026) took 2260 ms. Trace:
I20260807 15:11:19.286638 1124 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:19.328294 29567 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 11.
I20260807 15:11:19.803661 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 3386) took 1161 ms. Trace:
I20260807 15:11:19.804169 29567 rpcz_store.cc:276] 0807 15:11:18.642325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.925818 (+283493us) service_pool.cc:227] Handling call
0807 15:11:19.803583 (+877765us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:19.451022 29487 rpcz_store.cc:276] 0807 15:11:17.320482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.946821 (+1626339us) service_pool.cc:227] Handling call
0807 15:11:18.947117 (+ 296us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:18.947327 (+ 210us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:18.947348 (+ 21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:18.947383 (+ 35us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:18.947409 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.947473 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:18.947593 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:19.387660 1223 log.cc:924] Time spent T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 2.228s user 0.004s sys 0.002s
I20260807 15:11:19.743045 1182 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:19.353560 1273 log.cc:924] Time spent T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260807 15:11:19.757319 1256 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:19.341526 1272 log.cc:924] Time spent T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
W20260807 15:11:19.445264 1102 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s user 0.012s sys 0.016s
I20260807 15:11:19.816602 1256 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:19.472348 29637 raft_consensus.cc:2454] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:19.818442 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.444489 1230 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:19.446122 1078 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:19.485586 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.476372 30312 rpcz_store.cc:276] 0807 15:11:16.402917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.403421 (+ 504us) service_pool.cc:227] Handling call
0807 15:11:16.403809 (+ 388us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:17.409698 (+1005889us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.962402 (+1552704us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400850554. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:18.968650 (+ 6248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2311443328}
I20260807 15:11:19.832679 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3390) took 1150 ms. Trace:
I20260807 15:11:19.488839 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.458107 1123 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:19.525019 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:19.497707 29533 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.544s user 0.005s sys 0.025s
W20260807 15:11:19.834641 29533 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.881s user 0.005s sys 0.030s
W20260807 15:11:19.835084 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 1.01962e+06us
I20260807 15:11:19.826344 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3207) took 2451 ms. Trace:
I20260807 15:11:19.836683 29487 rpcz_store.cc:276] 0807 15:11:17.374932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.825228 (+2450296us) service_pool.cc:227] Handling call
0807 15:11:19.825680 (+ 452us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.825902 (+ 222us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.825940 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.825996 (+ 56us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:19.826051 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.826122 (+ 71us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.826251 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:19.482056 1208 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s user 0.005s sys 0.025s
W20260807 15:11:19.547859 29531 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.014s sys 0.046s
W20260807 15:11:19.843842 29531 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.892s user 0.024s sys 0.046s
I20260807 15:11:19.843982 30274 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:19.844246 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 908899us
I20260807 15:11:19.500562 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.469096 1264 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.848340 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.488682 1178 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:19.626308 958 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s user 0.022s sys 0.019s
I20260807 15:11:19.687247 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 3388) took 1006 ms. Trace:
I20260807 15:11:19.888285 29565 rpcz_store.cc:276] 0807 15:11:18.681350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.958200 (+276850us) service_pool.cc:227] Handling call
0807 15:11:19.687174 (+728974us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:19.890214 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1103) took 1129 ms. Trace:
I20260807 15:11:19.890672 29565 rpcz_store.cc:276] 0807 15:11:18.761208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.889209 (+1128001us) service_pool.cc:227] Handling call
0807 15:11:19.889603 (+ 394us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.889827 (+ 224us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.889853 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.889894 (+ 41us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:19.889939 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.889998 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.890135 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:19.669955 1154 consensus_meta.cc:287] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 1.103s user 0.019s sys 0.016s
I20260807 15:11:19.893515 1174 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:19.895025 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 242599us
I20260807 15:11:19.684331 30305 raft_consensus.cc:2454] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:19.896937 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.898972 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.685261 29646 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:11:19.834473 1230 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:19.906208 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1101) took 1195 ms. Trace:
I20260807 15:11:19.683728 30311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 1027) took 2530 ms. Trace:
I20260807 15:11:19.704597 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3193) took 3299 ms. Trace:
W20260807 15:11:19.679073 1195 consensus_meta.cc:287] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 1.285s user 0.008s sys 0.016s
I20260807 15:11:19.659729 1173 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:19.725729 30308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48584 (request call id 811) took 2886 ms (client timeout 2151 ms). Trace:
I20260807 15:11:19.726436 30307 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260807 15:11:19.711119 1266 log.cc:924] Time spent T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.356s user 0.000s sys 0.002s
I20260807 15:11:19.752625 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.834923 1124 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:19.888150 958 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.294s user 0.023s sys 0.019s
I20260807 15:11:19.759840 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:19.937557 29642 raft_consensus.cc:2396] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260807 15:11:19.759812 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2369) took 1132 ms. Trace:
I20260807 15:11:19.799201 30304 rpcz_store.cc:276] 0807 15:11:17.153440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:17.153620 (+ 180us) service_pool.cc:227] Handling call
0807 15:11:17.154041 (+ 421us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:18.764299 (+1610258us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.413881 (+649582us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400691754. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:19.414135 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3689805568}
I20260807 15:11:19.940229 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.943581 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:19.940764 29609 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.635s user 0.027s sys 0.054s
W20260807 15:11:19.944554 29609 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.639s user 0.027s sys 0.054s
I20260807 15:11:19.938344 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1055) took 2933 ms. Trace:
I20260807 15:11:19.944844 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.816643 30306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 1020) took 3414 ms. Trace:
W20260807 15:11:19.820870 29560 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s user 0.015s sys 0.017s
I20260807 15:11:19.823032 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:19.842481 1123 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:19.819355 29637 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
W20260807 15:11:19.831054 29480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2364) took 1924 ms (client timeout 1945 ms). Trace:
I20260807 15:11:19.836041 29533 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:19.940712 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.649219 29640 raft_consensus.cc:2354] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 10. Current term is 11.
I20260807 15:11:19.839136 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1058) took 2417 ms. Trace:
I20260807 15:11:19.776536 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.722651 1168 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:19.846648 29531 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:19.852577 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.784677 1189 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:19.859596 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:19.946413 29560 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s user 0.015s sys 0.017s
W20260807 15:11:19.953473 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 106934us
I20260807 15:11:19.868817 29449 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:19.954710 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 86018.4us
I20260807 15:11:19.956411 29449 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:19.873054 1276 log.cc:924] Time spent T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.072s user 0.000s sys 0.001s
I20260807 15:11:19.803171 1280 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:19.913743 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:19.909219 30308 rpcz_store.cc:269] 0807 15:11:16.839378 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.839571 (+ 193us) service_pool.cc:227] Handling call
0807 15:11:19.725509 (+2885938us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54004687d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:19.725632 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":258529024}
W20260807 15:11:19.710464 1170 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.385s user 0.095s sys 0.160s
I20260807 15:11:19.906761 29563 rpcz_store.cc:276] 0807 15:11:18.710885 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.401635 (+690750us) service_pool.cc:227] Handling call
0807 15:11:19.402103 (+ 468us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.450046 (+ 47943us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.450101 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.450147 (+ 46us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:19.450183 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.905904 (+455721us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b540022c754. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:19.905968 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.906137 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":109575424}
I20260807 15:11:19.934633 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:19.757303 29488 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:19.907927 30311 rpcz_store.cc:276] 0807 15:11:17.153820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:17.171359 (+ 17539us) service_pool.cc:227] Handling call
0807 15:11:17.254824 (+ 83465us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:18.045236 (+790412us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:18.045283 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:18.095019 (+ 49736us) log.cc:842] Serialized 26 byte log entry
0807 15:11:18.530357 (+435338us) raft_consensus.cc:1631] Marking committed up to 9
0807 15:11:19.683029 (+1152672us) log.cc:842] Serialized 14 byte log entry
0807 15:11:19.683309 (+ 280us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.683395 (+ 86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:19.683451 (+ 56us) raft_consensus.cc:1671] finished
0807 15:11:19.683462 (+ 11us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.683656 (+ 194us) inbound_call.cc:173] Queueing success response
0807 15:11:19.816332 (+132676us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b18002fe720. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e69f96 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11
0807 15:11:19.830716 (+ 14384us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b18002fe720. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
Metrics: {"mutex_wait_us":117107,"prepare.queue_time_us":1152426,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":174989,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":27530,"spinlock_wait_cycles":54092032,"thread_start_us":2225120,"threads_started":3,"wal-append.queue_time_us":747067}
I20260807 15:11:19.759634 1145 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:19.847498 1078 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.847760 1102 raft_consensus.cc:482] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:19.869477 1153 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 15:11:19.908995 29483 rpcz_store.cc:276] 0807 15:11:16.405147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.405344 (+ 197us) service_pool.cc:227] Handling call
0807 15:11:16.405850 (+ 506us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:16.630673 (+224823us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.630709 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:16.645470 (+ 14761us) log.cc:842] Serialized 26 byte log entry
0807 15:11:16.954990 (+309520us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800406a80. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e7e345 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e9be22 00007f94dba455bb 00007f94dba4b063 00007f94dba4b411 00007f94dbd985cf
0807 15:11:17.373099 (+418109us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:17.373140 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.704114 (+2330974us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400320854. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:19.704213 (+ 99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:19.704281 (+ 68us) raft_consensus.cc:1671] finished
0807 15:11:19.704302 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.704499 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14123,"raft.queue_time_us":173,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9324,"spinlock_wait_cycles":502888704,"thread_start_us":417909,"threads_started":1,"wal-append.queue_time_us":965505,"wal-append.run_cpu_time_us":21985,"wal-append.run_wall_time_us":1561378}
I20260807 15:11:19.937702 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.820143 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3370) took 2829 ms. Trace:
I20260807 15:11:19.980966 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:19.981809 29637 raft_consensus.cc:2379] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 7: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:19.942564 29566 rpcz_store.cc:276] 0807 15:11:18.627309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.763081 (+135772us) service_pool.cc:227] Handling call
0807 15:11:19.759583 (+996502us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b540006ed54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:19.759748 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":102946048}
W20260807 15:11:19.944973 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 639755us
I20260807 15:11:19.948129 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3208) took 2430 ms. Trace:
I20260807 15:11:19.983042 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:19.983234 29482 rpcz_store.cc:276] 0807 15:11:17.517857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.947067 (+2429210us) service_pool.cc:227] Handling call
0807 15:11:19.947515 (+ 448us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.947750 (+ 235us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.947780 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.947824 (+ 44us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:19.947864 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.947956 (+ 92us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.948070 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:19.949199 29480 rpcz_store.cc:269] 0807 15:11:17.896962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.600756 (+703794us) service_pool.cc:227] Handling call
0807 15:11:19.821502 (+1220746us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54001649d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:19.821630 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":192695040}
W20260807 15:11:19.949515 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 113627us
I20260807 15:11:19.985314 29533 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:19.985540 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.986243 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:19.981053 29484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1059) took 2397 ms. Trace:
I20260807 15:11:19.950811 29487 rpcz_store.cc:276] 0807 15:11:17.421761 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.837998 (+2416237us) service_pool.cc:227] Handling call
0807 15:11:19.838431 (+ 433us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.838686 (+ 255us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.838726 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.838783 (+ 57us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:19.838840 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.838921 (+ 81us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.839060 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:19.779093 1269 log.cc:924] Time spent T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260807 15:11:19.952219 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.944988 29486 rpcz_store.cc:276] 0807 15:11:17.004668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.928722 (+1924054us) service_pool.cc:227] Handling call
0807 15:11:18.929189 (+ 467us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:18.929565 (+ 376us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:18.929599 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:18.961315 (+ 31716us) log.cc:842] Serialized 26 byte log entry
0807 15:11:19.681311 (+719996us) raft_consensus.cc:1631] Marking committed up to 9
0807 15:11:19.681359 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.681465 (+ 106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:19.938078 (+256613us) raft_consensus.cc:1671] finished
0807 15:11:19.938105 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.938273 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2511,"raft.queue_time_us":853,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":13327,"thread_start_us":495795,"threads_started":1,"wal-append.queue_time_us":868072}
I20260807 15:11:19.986856 29484 rpcz_store.cc:276] 0807 15:11:17.584084 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.951391 (+2367307us) service_pool.cc:227] Handling call
0807 15:11:19.980371 (+ 28980us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.980606 (+ 235us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.980646 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.980718 (+ 72us) raft_consensus.cc:1631] Marking committed up to 12
0807 15:11:19.980772 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.980851 (+ 79us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.980981 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:19.945655 30306 rpcz_store.cc:276] 0807 15:11:16.402267 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.402423 (+ 156us) service_pool.cc:227] Handling call
0807 15:11:16.402870 (+ 447us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:16.403356 (+ 486us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:16.403399 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:16.415560 (+ 12161us) log.cc:842] Serialized 26 byte log entry
0807 15:11:16.786114 (+370554us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:17.453462 (+667348us) log.cc:842] Serialized 14 byte log entry
0807 15:11:17.453743 (+ 281us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:17.453820 (+ 77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:19.386096 (+1932276us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b44000232cc. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8daea95 00007f94d8daf4b2 00007f94dba57511 00007f94dba52e1a 00007f94dba46bee 00007f94dba45f36 00007f94dba45b58 00007f94dba4f551 00007f94dba4f509 00007f94dba4f499
0807 15:11:19.816229 (+430133us) raft_consensus.cc:1671] finished
0807 15:11:19.816374 (+ 145us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.816560 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58888,"prepare.queue_time_us":761485,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":16637,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":33039,"spinlock_wait_cycles":452226688,"thread_start_us":851406,"threads_started":2,"wal-append.queue_time_us":544860}
I20260807 15:11:19.954391 30304 raft_consensus.cc:2454] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:11:19.958935 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:19.938354 1174 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:20.017848 1281 raft_consensus.cc:2781] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:20.018729 1281 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:20.019384 1281 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:19.975033 1178 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:20.022598 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.024673 1217 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:19.945858 1133 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:19.824690 1182 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.051496 29484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1062) took 1431 ms. Trace:
I20260807 15:11:19.960017 1208 raft_consensus.cc:2781] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:19.991789 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.986363 30309 raft_consensus.cc:2354] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 10. Current term is 11.
I20260807 15:11:19.993579 29533 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:19.994516 29640 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 10: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:19.996104 1280 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.997061 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:19.990679 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2375) took 1427 ms. Trace:
I20260807 15:11:19.998777 29480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2363) took 2172 ms. Trace:
I20260807 15:11:19.981417 29570 rpcz_store.cc:276] 0807 15:11:16.990426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:17.047440 (+ 57014us) service_pool.cc:227] Handling call
0807 15:11:17.104814 (+ 57374us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:17.115975 (+ 11161us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:17.116022 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:17.136999 (+ 20977us) log.cc:842] Serialized 26 byte log entry
0807 15:11:18.043295 (+906296us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:18.043349 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:18.043428 (+ 79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:19.819834 (+1776406us) raft_consensus.cc:1671] finished
0807 15:11:19.819865 (+ 31us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.820068 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12529,"raft.queue_time_us":17288,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":16877,"thread_start_us":905922,"threads_started":1,"wal-append.queue_time_us":1497409}
I20260807 15:11:19.955075 1175 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:19.956338 1253 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:20.005838 29609 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:20.006523 1145 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:19.947911 1247 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:19.975944 958 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:11:19.936784 1173 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:20.042050 1040 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.520s user 0.055s sys 0.071s
W20260807 15:11:20.073577 1040 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.576s user 0.056s sys 0.071s
I20260807 15:11:20.073839 1040 raft_consensus.cc:686] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [term 7 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:20.074095 1258 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.074775 1173 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:19.970445 1189 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.074731 1040 consensus_queue.cc:237] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.076005 1264 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.076236 996 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader election won for term 11
I20260807 15:11:20.026887 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.077296 30306 raft_consensus.cc:2379] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 7: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:20.071558 1253 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.077397 1078 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.069593 1031 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.078349 1145 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.078809 30306 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 15:11:20.079176 1253 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.078945 1145 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:19.986855 1268 consensus_queue.cc:1035] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260807 15:11:20.081084 1145 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.081825 1168 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.071622 1175 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:20.083370 29569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1092) took 3026 ms (client timeout 2193 ms). Trace:
W20260807 15:11:20.083776 29569 rpcz_store.cc:269] 0807 15:11:17.056499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:17.149038 (+ 92539us) service_pool.cc:227] Handling call
0807 15:11:20.083154 (+2934116us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b5400190d54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:20.083277 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6004421888}
I20260807 15:11:20.085083 996 raft_consensus.cc:686] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 11 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:11:20.086370 30310 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48588 (request call id 1031) took 1564 ms (client timeout 1521 ms). Trace:
I20260807 15:11:19.978695 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:20.086834 30310 rpcz_store.cc:269] 0807 15:11:18.521639 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.522205 (+ 566us) service_pool.cc:227] Handling call
0807 15:11:20.086138 (+1563933us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b54001009d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:20.086263 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":184534912}
I20260807 15:11:19.972672 29452 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:20.088932 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 116380us
I20260807 15:11:20.089210 30307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48588 (request call id 1025) took 3254 ms. Trace:
I20260807 15:11:20.089572 30307 rpcz_store.cc:276] 0807 15:11:16.834506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:16.834639 (+ 133us) service_pool.cc:227] Handling call
0807 15:11:16.962643 (+128004us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b5800005198. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64851 00007f94d8e64702 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d1a2b0 00007f94e0d057f9 00007f94e0d052a2 00007f94da3eb684
0807 15:11:19.726165 (+2763522us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:19.910079 (+183914us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.089012 (+178933us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b54004687d0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:20.089140 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6358495232}
I20260807 15:11:20.093158 1280 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.067852 30304 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
I20260807 15:11:20.068028 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.068773 29486 rpcz_store.cc:276] 0807 15:11:18.563039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.987603 (+1424564us) service_pool.cc:227] Handling call
0807 15:11:19.990068 (+ 2465us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.990270 (+ 202us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.990311 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.990377 (+ 66us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:19.990411 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.990484 (+ 73us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.990609 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:19.940021 1124 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:19.969110 991 raft_consensus.cc:2726] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:11:20.069823 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 64090us
I20260807 15:11:20.016547 1174 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.070950 29480 rpcz_store.cc:276] 0807 15:11:17.826841 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.997683 (+2170842us) service_pool.cc:227] Handling call
0807 15:11:19.998098 (+ 415us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.998349 (+ 251us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.998386 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.998437 (+ 51us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:19.998499 (+ 62us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.998575 (+ 76us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.998699 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:20.095343 30311 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:11:20.052114 29484 rpcz_store.cc:276] 0807 15:11:18.620503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.988299 (+1367796us) service_pool.cc:227] Handling call
0807 15:11:20.050835 (+ 62536us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:20.051054 (+ 219us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:20.051090 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:20.051140 (+ 50us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:20.051182 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.051247 (+ 65us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:20.051407 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:20.086051 996 consensus_queue.cc:237] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.091535 29452 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:19.969722 926 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:20.067945 30308 raft_consensus.cc:2454] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:20.128409 29609 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:20.138885 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 145195us
I20260807 15:11:19.992529 821 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260807 15:11:20.152190 29533 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:20.156611 29533 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:20.158159 1249 raft_consensus.cc:2781] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:11:20.158864 1249 raft_consensus.cc:686] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [term 7 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:20.067469 1208 raft_consensus.cc:482] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.157753 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:19.989781 1102 raft_consensus.cc:504] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:20.154433 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 62990.2us
I20260807 15:11:20.094200 1257 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:20.171445 29452 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:20.076706 1189 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.169214 958 raft_consensus.cc:2781] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:20.163779 1248 raft_consensus.cc:2781] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:20.168071 1208 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:11:20.205020 29488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2367) took 1644 ms (client timeout 1766 ms). Trace:
W20260807 15:11:20.205610 29488 rpcz_store.cc:269] 0807 15:11:18.560322 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.731474 (+171152us) service_pool.cc:227] Handling call
0807 15:11:20.204177 (+1472703us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54003ae8d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:20.204931 (+ 754us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2159956864}
W20260807 15:11:20.207580 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 494076us
I20260807 15:11:20.184607 29609 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:20.174651 1116 consensus_queue.cc:1046] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260807 15:11:20.184731 29533 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:20.170984 1253 raft_consensus.cc:2781] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:20.036060 30274 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
W20260807 15:11:20.219734 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 183833us
I20260807 15:11:20.227908 29533 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:20.231559 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.230093 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.234508 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.235594 30308 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 10.
I20260807 15:11:20.178366 991 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:20.252765 29533 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:20.180305 958 raft_consensus.cc:482] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:20.192905 1248 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:20.259972 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 380658us
W20260807 15:11:20.244650 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 288325us
I20260807 15:11:20.204661 1189 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:20.259058 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3392) took 1546 ms. Trace:
I20260807 15:11:20.242002 1265 raft_consensus.cc:2781] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:20.269582 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.271263 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.274458 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.286480 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.287791 29452 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:20.325762 1031 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:20.326305 1031 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:20.326754 1031 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:11:20.332043 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 44394.8us
I20260807 15:11:20.307646 29449 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:20.308265 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:20.333420 29566 raft_consensus.cc:2396] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260807 15:11:20.333789 29449 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:20.334364 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:20.334935 29449 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:20.335465 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:20.336035 29566 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:20.336093 991 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:20.240902 1108 raft_consensus.cc:2781] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:20.336777 991 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:20.337044 1108 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.337411 991 raft_consensus.cc:2726] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 15:11:20.222515 1253 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.338256 1253 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:20.251416 1246 raft_consensus.cc:2781] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:20.315213 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:20.168929 926 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.341498 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:20.342888 926 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.343358 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:20.344439 29569 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:20.345770 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:20.346910 29569 raft_consensus.cc:2379] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:20.347959 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:20.340164 1246 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:20.348765 1246 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:20.354270 29449 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:20.356038 1173 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:20.356521 1173 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:20.356971 1173 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:20.258638 29486 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 9. Current term is 10. Ops: []
I20260807 15:11:20.337481 1108 raft_consensus.cc:3037] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:20.268183 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.378811 1108 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.385782 30273 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:20.395426 1108 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.399361 1258 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:20.400099 1258 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.403487 1258 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.406944 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.407860 29480 raft_consensus.cc:2454] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:20.410599 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.418298 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.159981 1249 consensus_queue.cc:237] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.437515 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:20.438917 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 126618us
I20260807 15:11:20.443367 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.445421 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.445844 30272 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:20.271169 1118 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:20.273237 958 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:20.261770 1282 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:20.450870 29452 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:20.440217 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 119099us
W20260807 15:11:20.457438 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 71787.6us
I20260807 15:11:20.223533 1043 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260807 15:11:20.263422 1116 raft_consensus.cc:482] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:20.262614 1295 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:20.182564 1289 consensus_queue.cc:1046] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.141s
W20260807 15:11:20.460604 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 203529us
I20260807 15:11:20.463146 29566 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10.
I20260807 15:11:20.309870 1248 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:11:20.464407 29481 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s user 0.017s sys 0.008s
I20260807 15:11:20.415771 1246 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:20.494028 29481 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.653s user 0.017s sys 0.009s
I20260807 15:11:20.251031 1015 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.183s
I20260807 15:11:20.472077 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:20.495524 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3206) took 3160 ms. Trace:
I20260807 15:11:20.467401 1118 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.317379 1290 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.420982 1265 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:20.251391 1256 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:20.483271 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 366998us
I20260807 15:11:20.496722 30311 raft_consensus.cc:2379] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 10: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:20.317790 1189 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.459095 1108 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:20.469012 973 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:20.497269 30272 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:20.498457 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:20.496438 29481 rpcz_store.cc:276] 0807 15:11:17.335483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.949945 (+1614462us) service_pool.cc:227] Handling call
0807 15:11:19.062946 (+113001us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:19.076035 (+ 13089us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.076071 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:19.076739 (+ 668us) log.cc:842] Serialized 26 byte log entry
0807 15:11:19.688806 (+612067us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:20.494720 (+805914us) log.cc:842] Serialized 14 byte log entry
0807 15:11:20.495044 (+ 324us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.495152 (+ 108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:20.495217 (+ 65us) raft_consensus.cc:1671] finished
0807 15:11:20.495237 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:20.495440 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45736,"prepare.queue_time_us":786494,"raft.queue_time_us":13788,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":31561,"thread_start_us":1147072,"threads_started":2,"wal-append.queue_time_us":830647}
I20260807 15:11:20.518981 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.472088 1268 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:20.503077 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.504550 29450 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:20.503309 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 234280us
I20260807 15:11:20.481925 1192 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:11:20.513083 29567 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s user 0.063s sys 0.118s
W20260807 15:11:20.544711 29567 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s user 0.063s sys 0.118s
I20260807 15:11:20.514521 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.486106 1295 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.546169 1295 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:20.513639 1031 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.546461 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.521166 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.547802 30304 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:20.548779 29565 raft_consensus.cc:1226] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:20.521854 29480 raft_consensus.cc:2396] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260807 15:11:20.551481 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.552325 30312 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 5.
I20260807 15:11:20.553552 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:20.542305 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:20.505954 1118 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:20.556838 29533 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:20.512678 1265 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:20.548928 29481 raft_consensus.cc:2354] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6.
I20260807 15:11:20.507254 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:20.556780 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3393) took 1823 ms. Trace:
I20260807 15:11:20.516425 1171 raft_consensus.cc:3032] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 12 LEADER]: Stepping down as leader of term 12
I20260807 15:11:20.490124 1116 raft_consensus.cc:504] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.542527 1007 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:20.558166 1258 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:11:20.541738 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 46041.7us
I20260807 15:11:20.515256 1189 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:20.553743 29452 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:20.568812 30311 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 15:11:20.569679 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.580482 29486 raft_consensus.cc:2454] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 10.
I20260807 15:11:20.464478 1173 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.538976 1124 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.572382 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.601687 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.572677 30272 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:20.570449 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:20.497359 1288 consensus_queue.cc:1046] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260807 15:11:20.570833 1301 log.cc:924] Time spent T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.082s user 0.000s sys 0.001s
I20260807 15:11:20.601676 30274 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:20.571949 1296 log.cc:924] Time spent T 4db6cf72c3b74ea19f67f0d479e0b364 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.389s user 0.000s sys 0.001s
I20260807 15:11:20.557976 1174 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.559217 1078 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:20.562378 1280 raft_consensus.cc:2781] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 15:11:20.631886 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 61534.2us
I20260807 15:11:20.512422 1290 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.605957 29480 raft_consensus.cc:2454] T 030a7060e7f744ff9a4e02ea0cd710bd P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:20.561873 1217 raft_consensus.cc:2726] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:20.602113 1145 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.630710 1289 raft_consensus.cc:3032] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:20.562018 1171 raft_consensus.cc:729] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:20.639411 1007 raft_consensus.cc:2781] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:20.635824 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:20.633056 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 60446.9us
I20260807 15:11:20.548497 1108 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:20.640802 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 78541us
I20260807 15:11:20.637809 1102 leader_election.cc:288] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.678179 29533 leader_election.cc:398] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 10. Current term is 11.
I20260807 15:11:20.678520 29533 leader_election.cc:401] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:11:20.559937 1306 raft_consensus.cc:482] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.601472 1302 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:20.646209 1153 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 15:11:20.655203 1311 log.cc:924] Time spent T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260807 15:11:20.667699 1154 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260807 15:11:20.665475 1307 log.cc:924] Time spent T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
W20260807 15:11:20.666456 1304 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.103s user 0.000s sys 0.000s
I20260807 15:11:20.672183 30272 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:20.713798 30272 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:20.677379 1007 raft_consensus.cc:482] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:20.684037 30309 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 3.
W20260807 15:11:20.686025 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 183243us
I20260807 15:11:20.752629 29608 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:20.655318 1145 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.701771 29484 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 9. Current term is 10. Ops: []
I20260807 15:11:20.706982 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:11:20.681118 1123 consensus_meta.cc:287] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.705s user 0.005s sys 0.009s
I20260807 15:11:20.668937 1289 raft_consensus.cc:729] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:20.680389 29533 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:20.744396 1170 raft_consensus.cc:3032] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:20.744562 1297 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 15:11:20.746099 1171 consensus_queue.cc:260] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:20.759423 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 88625.4us
I20260807 15:11:20.750481 1153 raft_consensus.cc:2781] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:20.685401 1217 raft_consensus.cc:2726] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) with higher term. Message: Invalid argument: T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 10. Current term is 11.
I20260807 15:11:20.720294 30272 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
W20260807 15:11:20.760006 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 79730.5us
I20260807 15:11:20.692149 1302 raft_consensus.cc:482] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:20.667912 1253 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.748979 1116 leader_election.cc:288] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.781431 1248 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.705377 1154 raft_consensus.cc:482] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:20.677887 1078 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.759938 29608 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:20.777377 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 57164.6us
I20260807 15:11:20.776260 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:20.794906 30311 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:20.751699 1102 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:20.757468 1007 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:20.775689 1153 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:20.801142 1153 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:20.767952 1322 raft_consensus.cc:2781] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:20.783134 1302 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
W20260807 15:11:20.772080 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 292450us
I20260807 15:11:20.758385 1031 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.765895 1246 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:11:20.796701 29367 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fbf78964d70448269802ac7de9d7a198 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } } }
I20260807 15:11:20.771400 1170 raft_consensus.cc:729] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:20.775863 29533 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:11:20.837527 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 61742.1us
I20260807 15:11:20.784981 1260 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260807 15:11:20.791752 1230 consensus_meta.cc:287] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.890s user 0.009s sys 0.008s
W20260807 15:11:20.808010 1308 log.cc:924] Time spent T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.123s user 0.001s sys 0.000s
I20260807 15:11:20.798098 973 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:20.793107 1154 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Advancing to term 11
W20260807 15:11:20.794392 1281 consensus_meta.cc:287] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.774s user 0.006s sys 0.007s
I20260807 15:11:20.818835 926 consensus_queue.cc:1046] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:20.773449 1178 consensus_queue.cc:1046] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260807 15:11:20.791123 1256 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.761736 1123 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.794551 1171 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 12 FOLLOWER]: Advancing to term 13
I20260807 15:11:20.832684 1253 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.702441 1306 raft_consensus.cc:504] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.840526 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:20.842056 30311 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:11:20.813004 1315 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:20.805126 1322 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:20.837337 1245 consensus_meta.cc:287] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.083s user 0.006s sys 0.009s
I20260807 15:11:20.813716 1108 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.904049 1322 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:11:20.909577 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 69726.9us
W20260807 15:11:20.917780 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 96989us
I20260807 15:11:20.899041 1173 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:20.897109 1315 raft_consensus.cc:482] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:20.869516 1230 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.931041 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:20.869140 973 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.885792 958 raft_consensus.cc:504] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.956609 29452 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:20.936499 29485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1054) took 3932 ms. Trace:
I20260807 15:11:20.935421 29482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3210) took 3185 ms. Trace:
W20260807 15:11:20.928931 1208 consensus_meta.cc:287] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.667s user 0.013s sys 0.000s
I20260807 15:11:20.921046 1123 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.941948 29569 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:11:20.930186 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 126451us
I20260807 15:11:20.959357 29482 rpcz_store.cc:276] 0807 15:11:17.750391 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.996265 (+2245874us) service_pool.cc:227] Handling call
0807 15:11:20.204329 (+208064us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:20.204533 (+ 204us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:20.204560 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:20.204611 (+ 51us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:20.204643 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.204702 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:20.935199 (+730497us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003ae8d0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:20.935350 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":477613440}
I20260807 15:11:20.959275 29485 rpcz_store.cc:276] 0807 15:11:17.004406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.927495 (+1923089us) service_pool.cc:227] Handling call
0807 15:11:18.927738 (+ 243us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.461530 (+533792us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.461565 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.461610 (+ 45us) raft_consensus.cc:1631] Marking committed up to 10
0807 15:11:19.461675 (+ 65us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.936196 (+1474521us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54001b4c54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:20.936264 (+ 68us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:20.936428 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1227088768}
I20260807 15:11:20.972353 29480 raft_consensus.cc:1226] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:20.929513 1317 raft_consensus.cc:2726] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:20.909006 1245 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:20.938429 1315 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:20.879707 1281 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:20.814464 1289 consensus_queue.cc:260] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:20.964540 1298 log.cc:924] Time spent T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.166s user 0.000s sys 0.001s
I20260807 15:11:20.981355 29488 raft_consensus.cc:2379] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 6: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:20.927124 1253 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260807 15:11:20.966244 1173 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:20.966995 1040 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:20.970392 1290 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.001559 1329 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 15:11:21.002632 1245 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.002574 1329 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:21.002018 973 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.012051 1178 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.013175 1178 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.018425 1281 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:20.994282 1289 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:21.052456 29450 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.056311 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.056746 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.057466 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.057617 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:20.988143 1248 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.064518 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.065826 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.059576 30304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.067113 30304 raft_consensus.cc:2379] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 5: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:21.060401 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.068213 29450 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:20.973248 1208 raft_consensus.cc:504] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.057065 29641 raft_consensus.cc:2362] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7. Re-sending same reply.
I20260807 15:11:21.080308 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:21.085158 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:21.084977 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.084990 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:21.093092 29640 raft_consensus.cc:1261] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 3 index: 6. (term mismatch)
I20260807 15:11:21.093688 29640 pending_rounds.cc:76] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Aborting all ops after (but not including) 5
I20260807 15:11:21.093560 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.093930 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.094120 29640 pending_rounds.cc:97] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260807 15:11:21.094533 29640 raft_consensus.cc:2866] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:11:21.094640 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.096458 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:21.099752 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:21.092626 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.100951 30307 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 5: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:21.049528 1173 raft_consensus.cc:686] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:20.993620 1324 raft_consensus.cc:2781] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:21.064395 1293 raft_consensus.cc:2781] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:21.064949 1145 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.109563 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:21.069686 1321 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:21.063784 1181 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.113983 29563 raft_consensus.cc:2379] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:21.071512 1258 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 15:11:21.070915 1245 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.003943 1040 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.124415 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:21.010355 1329 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.139065 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:21.136456 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.134219 1145 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:21.147719 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.149923 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.151368 29566 raft_consensus.cc:2454] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:11:21.153544 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:21.115327 1118 consensus_meta.cc:287] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.554s user 0.002s sys 0.013s
I20260807 15:11:21.155117 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:21.151073 29569 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:11:21.158993 29485 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:21.108932 1281 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.114670 1319 raft_consensus.cc:3032] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 9 LEADER]: Stepping down as leader of term 9
W20260807 15:11:21.164690 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 96607.9us
I20260807 15:11:21.171489 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.174260 29450 leader_election.cc:302] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:21.124536 1324 raft_consensus.cc:482] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.135296 1293 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.194973 29641 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 9. Current term is 10. Ops: []
I20260807 15:11:21.184227 29638 raft_consensus.cc:1261] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 15:11:21.185743 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.197723 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.166991 1329 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:21.200062 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.198696 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.209759 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.211198 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:21.213371 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.215914 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.193346 1031 raft_consensus.cc:2781] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader election won for term 10
I20260807 15:11:21.182024 1319 raft_consensus.cc:729] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:21.181914 1325 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.217674 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.197202 1248 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.201588 1293 raft_consensus.cc:3037] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:21.152783 1245 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.195588 1230 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.205462 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.215520 1108 raft_consensus.cc:2781] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 15:11:21.223734 29533 leader_election.cc:302] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.223866 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.237792 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.239101 29485 raft_consensus.cc:2454] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:21.240931 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:11:21.219098 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 433594us
I20260807 15:11:21.202342 1249 raft_consensus.cc:2781] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:21.163100 1118 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.204977 1043 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:21.136444 1181 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.153134 1321 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.216995 1306 leader_election.cc:288] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.195722 1324 raft_consensus.cc:3037] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:21.179251 1281 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.258457 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3211) took 3302 ms. Trace:
I20260807 15:11:21.230068 1248 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.211426 1173 consensus_queue.cc:237] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.245046 1249 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.191463 1322 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.239034 1256 raft_consensus.cc:2726] T f4c7484fae4742a2a93ad8d15ee4241c P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 15:11:21.236394 1332 log.cc:924] Time spent T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.240s user 0.002s sys 0.000s
W20260807 15:11:21.249019 1189 consensus_meta.cc:287] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.616s user 0.013s sys 0.004s
I20260807 15:11:21.227618 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.229528 1178 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.236685 1108 raft_consensus.cc:482] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.259366 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.227885 1325 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.266816 29487 rpcz_store.cc:276] 0807 15:11:17.956432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.994535 (+2038103us) service_pool.cc:227] Handling call
0807 15:11:19.994935 (+ 400us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:20.155104 (+160169us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:20.155148 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:20.169741 (+ 14593us) log.cc:842] Serialized 26 byte log entry
0807 15:11:20.438804 (+269063us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:20.438870 (+ 66us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:21.249745 (+810875us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001b5154. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:21.249802 (+ 57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:21.249871 (+ 69us) raft_consensus.cc:1671] finished
0807 15:11:21.249888 (+ 17us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:21.258386 (+ 8498us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2296,"raft.queue_time_us":7994,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5471,"spinlock_wait_cycles":362096000,"thread_start_us":252419,"threads_started":1,"wal-append.queue_time_us":321745}
W20260807 15:11:21.269227 29432 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet e6a9409698ac457faa20f77f1cf661a7, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.233587 1031 raft_consensus.cc:686] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:21.235081 1319 consensus_queue.cc:260] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.282039 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.347647 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.348763 29569 raft_consensus.cc:2379] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:21.349475 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:21.349795 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.285000 29646 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:21.350929 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:21.285187 30310 raft_consensus.cc:1226] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260807 15:11:21.351397 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:21.285687 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:21.286063 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.216007 1334 raft_consensus.cc:482] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.256423 1043 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.312664 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.307739 29644 raft_consensus.cc:2454] T 748d0394657643cfbf71e2bac60ff2f2 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:21.323047 1145 raft_consensus.cc:482] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.256297 1208 leader_election.cc:288] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.336532 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b21bbc939b9464c8729e18e5401dd65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:21.339833 29432 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet e6a9409698ac457faa20f77f1cf661a7, TS 00dd11bf8fd9487580aba733c2996a4a -> TS fbf78964d70448269802ac7de9d7a198 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.340308 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:21.309834 1249 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:21.345906 30304 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260807 15:11:21.300724 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 62985.8us
I20260807 15:11:21.485571 30303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39994 (request call id 1554) took 2278 ms. Trace:
I20260807 15:11:21.487030 30303 rpcz_store.cc:276] 0807 15:11:19.210390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:20.023823 (+813433us) service_pool.cc:227] Handling call
0807 15:11:20.087802 (+ 63979us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:20.141059 (+ 53257us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:20.151162 (+ 10103us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:20.162481 (+ 11319us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:20.167943 (+ 5462us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.174917 (+ 6974us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:21.485319 (+1310402us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b54001009d0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:21.485488 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":146054528}
I20260807 15:11:21.468667 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:21.347254 1319 raft_consensus.cc:3037] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:21.426983 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:21.494846 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:21.492637 29533 leader_election.cc:302] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:11:21.490442 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 158809us
I20260807 15:11:21.491621 30307 raft_consensus.cc:1799] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Handling vote request from an unknown peer 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.493055 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:21.426983 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:21.498425 30307 raft_consensus.cc:2379] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:21.339146 1256 raft_consensus.cc:2781] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 15:11:21.484192 1302 consensus_meta.cc:287] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.672s user 0.008s sys 0.011s
W20260807 15:11:21.428385 1338 log.cc:924] Time spent T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.199s user 0.001s sys 0.000s
I20260807 15:11:21.508230 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:21.502962 29487 raft_consensus.cc:1261] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 15:11:21.502686 29531 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:21.504823 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.342201 1108 raft_consensus.cc:3037] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:21.494089 1031 consensus_queue.cc:237] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.391508 1040 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.511929 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.517051 1342 consensus_queue.cc:1046] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260807 15:11:21.521785 796 raft_consensus.cc:3037] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:21.524510 1322 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.491050 1181 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.497447 1245 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.512701 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.513455 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.338038 1340 raft_consensus.cc:482] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
W20260807 15:11:21.497548 1153 consensus_meta.cc:287] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.696s user 0.015s sys 0.010s
I20260807 15:11:21.479370 1321 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.529153 29569 raft_consensus.cc:2454] T 2fe1df4603dd4ecdad74103a84926118 P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 3.
I20260807 15:11:21.505345 1256 raft_consensus.cc:482] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.329564 1154 raft_consensus.cc:504] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.526993 29531 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:21.533037 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.534301 29485 raft_consensus.cc:1226] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:21.532195 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:21.516374 1007 consensus_meta.cc:287] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 0.715s user 0.014s sys 0.011s
I20260807 15:11:21.337574 1189 raft_consensus.cc:504] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.538196 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.542184 29449 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.544502 29566 raft_consensus.cc:2454] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 8.
I20260807 15:11:21.545267 29449 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.549484 1264 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:21.550395 1264 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 15:11:21.497656 1145 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:21.555297 29608 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.511674 1346 raft_consensus.cc:2781] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:21.552206 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.564778 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.565191 29531 leader_election.cc:302] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:21.568140 29531 leader_election.cc:302] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:21.531669 1248 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.572932 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.546968 1256 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:21.574738 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3387) took 2932 ms. Trace:
I20260807 15:11:21.575104 29569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.536124 1322 raft_consensus.cc:482] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.580006 29561 rpcz_store.cc:276] 0807 15:11:18.642632 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.056364 (+413732us) service_pool.cc:227] Handling call
0807 15:11:19.075652 (+ 19288us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.333153 (+257501us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.333188 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.333242 (+ 54us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:19.333300 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:21.574407 (+2241107us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002cf6d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:21.574474 (+ 67us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:21.574657 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":591536896}
I20260807 15:11:21.551856 1348 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:21.583531 29450 leader_election.cc:302] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:21.594249 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:21.595839 29531 leader_election.cc:302] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:21.533782 1344 raft_consensus.cc:2726] T 37e098505a6248f0aa9d91084fbbe64e P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:21.591691 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:21.600065 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:21.601249 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 56050.3us
I20260807 15:11:21.596153 29450 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.601799 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.602114 29449 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.602526 29561 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:21.603034 29450 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:21.576205 29644 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10.
I20260807 15:11:21.563457 1281 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.603727 29608 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.567262 1317 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:21.567175 1245 raft_consensus.cc:2726] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:11:21.580796 1171 consensus_meta.cc:287] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.682s user 0.009s sys 0.007s
I20260807 15:11:21.605464 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.564350 1118 leader_election.cc:288] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.611577 30273 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:21.593994 1265 consensus_meta.cc:287] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 1.025s user 0.014s sys 0.004s
I20260807 15:11:21.574024 1040 raft_consensus.cc:2726] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:21.513970 1302 raft_consensus.cc:504] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.626158 29482 raft_consensus.cc:2354] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6.
I20260807 15:11:21.627394 30273 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.616019 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.628719 29644 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:21.619974 29561 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:21.539706 1153 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.624625 1265 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.640447 1317 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:21.641279 1317 raft_consensus.cc:482] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.639518 30311 raft_consensus.cc:1226] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:21.598425 1322 raft_consensus.cc:504] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } }
I20260807 15:11:21.641952 1317 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:21.551491 1007 raft_consensus.cc:504] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.646407 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:21.639321 1153 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.571064 1182 consensus_queue.cc:1035] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260807 15:11:21.662307 29609 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.647758 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.603938 1264 raft_consensus.cc:2781] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:21.652251 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.652630 30273 leader_election.cc:302] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.652877 29531 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.673213 30273 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:21.500265 1334 raft_consensus.cc:504] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:21.674449 29531 leader_election.cc:334] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Timed out: RequestConsensusVote RPC to 127.27.144.195:33653 timed out after 1.695s (SENT)
I20260807 15:11:21.675016 29531 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.675360 1118 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:21.619170 1344 raft_consensus.cc:2726] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 15:11:21.668335 29609 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.677908 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.648388 1247 raft_consensus.cc:2726] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260807 15:11:21.646838 1265 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.681783 29561 raft_consensus.cc:2379] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 8: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:21.682669 30273 leader_election.cc:302] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:21.684932 29609 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.661166 1178 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:11:21.699859 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:21.701220 29561 raft_consensus.cc:2379] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 4: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:21.702919 1347 raft_consensus.cc:2726] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:21.660769 998 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.606117 1282 consensus_queue.cc:1035] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260807 15:11:21.666428 1325 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.676239 1118 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.670127 1171 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:21.709730 30273 leader_election.cc:302] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.689579 1329 raft_consensus.cc:2726] T 9b21bbc939b9464c8729e18e5401dd65 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:21.712031 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.677872 1264 raft_consensus.cc:482] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.545408 1340 raft_consensus.cc:504] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:21.733466 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 138105us
W20260807 15:11:21.740406 30273 leader_election.cc:334] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589): Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.193s (SENT)
I20260807 15:11:21.740878 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.712221 1153 raft_consensus.cc:2726] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:21.691627 1321 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 15:11:21.698184 1137 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:21.757026 29487 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 15:11:21.764514 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:21.765484 29487 raft_consensus.cc:2379] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 9: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:21.737067 1178 raft_consensus.cc:686] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:21.766494 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:21.767582 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:21.768463 30311 raft_consensus.cc:2379] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 5: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:21.767213 1178 consensus_queue.cc:237] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.772177 29486 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:21.736937 1118 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:11:21.741698 1283 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.070s user 0.002s sys 0.000s
I20260807 15:11:21.758559 29533 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.777432 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.779836 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:21.780905 29485 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:21.735502 1043 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.738695 998 raft_consensus.cc:2781] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:21.750560 1225 raft_consensus.cc:2781] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 15:11:21.742262 1264 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:21.786530 29533 leader_election.cc:302] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.756410 1302 leader_election.cc:288] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.734089 1352 raft_consensus.cc:2726] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:21.794793 1334 leader_election.cc:288] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:21.794654 1173 consensus_queue.cc:1046] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:21.792409 998 raft_consensus.cc:482] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.754253 1189 leader_election.cc:288] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.762029 1322 leader_election.cc:288] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125)
I20260807 15:11:21.776571 1154 leader_election.cc:288] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:21.792901 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 147216us
I20260807 15:11:21.759670 1145 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.713521 1349 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:21.794813 1007 leader_election.cc:288] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.804680 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:21.797727 1295 consensus_meta.cc:287] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.251s user 0.007s sys 0.014s
I20260807 15:11:21.784845 1282 raft_consensus.cc:2726] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 15:11:21.799490 1315 consensus_meta.cc:287] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.809s user 0.004s sys 0.011s
I20260807 15:11:21.800895 1225 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.824862 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.823256 30304 raft_consensus.cc:1226] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:21.803825 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:21.821267 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:21.855389 30312 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:21.825860 29533 leader_election.cc:302] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:21.863313 29531 leader_election.cc:334] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653): Timed out: RequestConsensusVote RPC to 127.27.144.195:33653 timed out after 1.888s (SENT)
I20260807 15:11:21.864022 29531 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.824039 30273 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.842540 1352 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:21.817371 998 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:21.824764 1340 leader_election.cc:288] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:21.858702 29452 leader_election.cc:302] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.838982 29486 raft_consensus.cc:2454] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
W20260807 15:11:21.867476 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 43604.1us
I20260807 15:11:21.819269 1353 raft_consensus.cc:2726] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 15:11:21.949023 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 76860.9us
I20260807 15:11:21.856923 1225 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
W20260807 15:11:21.957499 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 98904.5us
I20260807 15:11:21.857123 1189 raft_consensus.cc:482] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:21.976241 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 373250us
I20260807 15:11:21.965418 29533 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:21.874423 1137 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:21.964815 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:21.979460 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.980230 1245 consensus_queue.cc:1046] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:21.981266 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:21.982343 1245 raft_consensus.cc:3032] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:21.955709 29485 raft_consensus.cc:2454] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 5.
I20260807 15:11:21.983042 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:20.311241 29564 rpcz_store.cc:276] 0807 15:11:18.712508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.822897 (+1110389us) service_pool.cc:227] Handling call
0807 15:11:19.857282 (+ 34385us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.857564 (+ 282us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 15:11:19.952186 (+ 94622us) log.cc:842] Serialized 14 byte log entry
0807 15:11:20.255683 (+303497us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:20.255740 (+ 57us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:20.255804 (+ 64us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.255879 (+ 75us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:20.259009 (+ 3130us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":89598,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":95,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":41117,"thread_start_us":302094,"threads_started":1}
I20260807 15:11:21.948397 1182 raft_consensus.cc:2726] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 15:11:21.972571 1283 log.cc:924] Time spent T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.101s user 0.001s sys 0.000s
I20260807 15:11:21.969817 1173 raft_consensus.cc:2726] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 15:11:21.876379 1282 raft_consensus.cc:2726] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 15:11:22.015120 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:22.037016 29485 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 9.
I20260807 15:11:21.979699 1353 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:22.005316 30312 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:11:22.020571 29449 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:22.028026 29531 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:21.856391 1315 raft_consensus.cc:504] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.041014 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:22.046789 29449 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:22.049057 29449 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:21.988651 1334 raft_consensus.cc:482] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:21.996470 1245 raft_consensus.cc:729] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:22.058496 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.080277 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:21.852711 1295 raft_consensus.cc:504] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:22.086655 29647 raft_consensus.cc:2379] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 6: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:22.084596 29533 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:22.087881 29564 raft_consensus.cc:2379] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 8: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:21.964519 1322 consensus_queue.cc:1046] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260807 15:11:22.051748 1182 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 15:11:22.089243 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:22.089327 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3382) took 3476 ms. Trace:
I20260807 15:11:22.096199 29644 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:22.000692 1189 raft_consensus.cc:504] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:21.948446 1347 consensus_queue.cc:1035] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.131s
I20260807 15:11:22.096154 29560 rpcz_store.cc:276] 0807 15:11:18.612530 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.612719 (+ 189us) service_pool.cc:227] Handling call
0807 15:11:18.613205 (+ 486us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 15:11:18.631257 (+ 18052us) raft_consensus.cc:1520] Early marking committed up to index 9
0807 15:11:18.961222 (+329965us) log.cc:842] Serialized 14 byte log entry
0807 15:11:19.953828 (+992606us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 15:11:19.983384 (+ 29556us) log.cc:842] Serialized 52 byte log entry
0807 15:11:19.983530 (+ 146us) raft_consensus.cc:1631] Marking committed up to 10
0807 15:11:19.983752 (+ 222us) log.cc:842] Serialized 14 byte log entry
0807 15:11:19.983986 (+ 234us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.984066 (+ 80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:20.003600 (+ 19534us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b180043da40. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:11:21.483969 (+1480369us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b180043da40. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e9c638 00007f94d8e9fb11 00007f94d8e9fac9 00007f94d8e9fa59 00007f94d8e9fa21 00007f94d8e9ed1d 00007f94e2100204 00007f94e2100039 00007f94d8e7edc6
0807 15:11:22.089085 (+605116us) raft_consensus.cc:1671] finished
0807 15:11:22.089110 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:22.089264 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17456,"prepare.queue_time_us":737799,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":133,"raft.queue_time_us":21352,"raft.run_cpu_time_us":501,"raft.run_wall_time_us":15777,"spinlock_wait_cycles":78644864,"thread_start_us":1157052,"threads_started":2,"wal-append.queue_time_us":929905}
I20260807 15:11:22.102525 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:22.103962 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.104354 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3202) took 4933 ms. Trace:
I20260807 15:11:22.104941 29479 rpcz_store.cc:276] 0807 15:11:17.170746 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:18.960339 (+1789593us) service_pool.cc:227] Handling call
0807 15:11:19.821715 (+861376us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.821961 (+ 246us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:19.822001 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.822088 (+ 87us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:19.822137 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.822208 (+ 71us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:22.104104 (+2281896us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54001649d0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.104271 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1980181888}
I20260807 15:11:22.106823 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:22.107523 29479 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:22.105644 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:22.115123 1356 log.cc:924] Time spent T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.247s user 0.000s sys 0.001s
I20260807 15:11:22.109941 29560 raft_consensus.cc:2454] T 8f248aa577ff4c798c99df5834ea66e5 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 7.
I20260807 15:11:22.092876 1350 raft_consensus.cc:2781] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 15:11:22.117908 30273 leader_election.cc:302] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:22.119683 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.124238 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d288f694924e79826a10fc7cff8351" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:22.125468 29560 raft_consensus.cc:2379] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:22.083707 1365 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:21.881201 1352 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:22.120851 1245 consensus_queue.cc:260] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:22.139050 1108 consensus_meta.cc:287] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.600s user 0.010s sys 0.005s
I20260807 15:11:21.970516 1344 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.133s
W20260807 15:11:22.126539 796 consensus_meta.cc:287] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.604s user 0.010s sys 0.006s
I20260807 15:11:22.158054 1108 raft_consensus.cc:504] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.100206 1302 raft_consensus.cc:2726] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 15:11:22.085448 1334 raft_consensus.cc:504] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.118572 1340 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:22.150368 1361 raft_consensus.cc:2781] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:22.157294 1245 raft_consensus.cc:3037] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:22.207562 1108 leader_election.cc:288] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 11 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:22.208148 1361 raft_consensus.cc:482] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:22.159868 29645 raft_consensus.cc:2396] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260807 15:11:22.161449 29644 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:22.099387 1359 raft_consensus.cc:2726] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:22.148809 1350 raft_consensus.cc:686] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:22.205917 1315 leader_election.cc:288] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:22.227960 1256 consensus_meta.cc:287] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.629s user 0.015s sys 0.001s
I20260807 15:11:22.229014 1256 raft_consensus.cc:504] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.238207 1175 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:22.261814 1280 raft_consensus.cc:482] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:22.262774 1280 raft_consensus.cc:3037] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:22.208604 1361 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:11:22.270421 1358 log.cc:924] Time spent T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.168s user 0.000s sys 0.001s
W20260807 15:11:22.280149 1362 log.cc:924] Time spent T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.134s user 0.001s sys 0.001s
I20260807 15:11:22.299670 1334 leader_election.cc:288] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:22.302976 1189 leader_election.cc:288] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:22.306900 1137 raft_consensus.cc:2726] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 15:11:22.290539 1324 consensus_meta.cc:287] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.003s user 0.013s sys 0.006s
I20260807 15:11:22.151216 1365 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.386058 1318 raft_consensus.cc:482] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:22.424672 1295 leader_election.cc:288] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:22.398340 1324 raft_consensus.cc:504] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.345021 1126 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:22.450552 1312 log.cc:924] Time spent T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 1.565s user 0.004s sys 0.008s
W20260807 15:11:22.411657 1319 consensus_meta.cc:287] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.912s user 0.005s sys 0.016s
I20260807 15:11:22.310636 1170 consensus_queue.cc:260] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.453002 1357 raft_consensus.cc:3032] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:22.387213 1318 raft_consensus.cc:504] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:22.492722 1357 raft_consensus.cc:729] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:22.435496 1350 consensus_queue.cc:237] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:22.489899 1317 consensus_meta.cc:287] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.827s user 0.006s sys 0.014s
W20260807 15:11:22.510020 1293 consensus_meta.cc:287] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.272s user 0.008s sys 0.013s
W20260807 15:11:22.519613 1346 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.873s user 0.004s sys 0.008s
I20260807 15:11:22.513809 1352 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:22.523254 1346 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.913s user 0.005s sys 0.009s
I20260807 15:11:22.526522 1346 raft_consensus.cc:686] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:22.523222 1324 leader_election.cc:288] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:22.582310 29450 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.524s user 0.002s sys 0.014s
W20260807 15:11:22.588790 29452 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.617s user 0.009s sys 0.000s
I20260807 15:11:22.590504 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:22.141829 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6072ace00c943b19f41dba76504e780" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.662196 29569 raft_consensus.cc:2454] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 5.
I20260807 15:11:22.209635 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:22.531714 1357 consensus_queue.cc:260] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.537926 1365 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:22.696264 1357 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:22.641656 1078 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:22.653523 29452 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.682s user 0.010s sys 0.000s
W20260807 15:11:22.654367 1349 consensus_meta.cc:287] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.830s user 0.000s sys 0.024s
I20260807 15:11:22.547719 1361 raft_consensus.cc:504] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:22.653131 29450 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.595s user 0.003s sys 0.015s
I20260807 15:11:22.667356 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fbc64c4dbd34587a70422db1adc925c" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:22.636447 1346 consensus_queue.cc:237] T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:22.655241 1256 leader_election.cc:288] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:22.665508 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:22.683573 1264 consensus_meta.cc:287] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.874s user 0.014s sys 0.004s
I20260807 15:11:22.682331 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:22.682268 796 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:22.520565 1293 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.708273 1334 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:22.716238 29488 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1071) took 2231 ms (client timeout 2017 ms). Trace:
I20260807 15:11:22.716650 29484 raft_consensus.cc:1226] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:22.725236 1349 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:19.833156 29568 rpcz_store.cc:276] 0807 15:11:18.681987 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.398886 (+716899us) service_pool.cc:227] Handling call
0807 15:11:19.399427 (+ 541us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.399658 (+ 231us) raft_consensus.cc:1520] Early marking committed up to index 7
0807 15:11:19.464894 (+ 65236us) log.cc:842] Serialized 14 byte log entry
0807 15:11:19.832312 (+367418us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:19.832367 (+ 55us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:19.832417 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:19.832489 (+ 72us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:19.832614 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36752,"prepare.queue_time_us":53577,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":5626,"raft.queue_time_us":37443,"thread_start_us":330136,"threads_started":1}
I20260807 15:11:22.729206 29480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1068) took 2245 ms. Trace:
I20260807 15:11:22.719595 1361 leader_election.cc:288] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:22.735450 796 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:22.733564 29488 rpcz_store.cc:269] 0807 15:11:20.484226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:20.488019 (+ 3793us) service_pool.cc:227] Handling call
0807 15:11:22.715621 (+2227602us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54001b4754. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.715945 (+ 324us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1010217856}
I20260807 15:11:22.746212 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3396) took 3316 ms. Trace:
I20260807 15:11:22.739418 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2392) took 1666 ms. Trace:
W20260807 15:11:22.757754 30274 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.543s user 0.001s sys 0.018s
W20260807 15:11:22.758229 30274 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.544s user 0.002s sys 0.019s
I20260807 15:11:22.765707 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.767236 29566 raft_consensus.cc:2379] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 6: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:22.768877 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "748d0394657643cfbf71e2bac60ff2f2" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.756695 29560 rpcz_store.cc:276] 0807 15:11:21.067920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.664388 (+1596468us) service_pool.cc:227] Handling call
0807 15:11:22.733815 (+ 69427us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.752131 29644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59992 (request call id 2664) took 1044 ms. Trace:
I20260807 15:11:22.770292 29644 rpcz_store.cc:276] 0807 15:11:21.692556 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.664845 (+972289us) service_pool.cc:227] Handling call
0807 15:11:22.736687 (+ 71842us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.679740 1170 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:22.752920 29480 rpcz_store.cc:276] 0807 15:11:20.483283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:20.650657 (+167374us) service_pool.cc:227] Handling call
0807 15:11:20.683149 (+ 32492us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:20.977493 (+294344us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:22.728549 (+1751056us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54001d4cd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:22.728965 (+ 416us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":664514304}
I20260807 15:11:22.756328 29565 rpcz_store.cc:276] 0807 15:11:19.430053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.894515 (+464462us) service_pool.cc:227] Handling call
0807 15:11:19.894799 (+ 284us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:20.549280 (+654481us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:22.745404 (+2196124us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400190354. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:22.745917 (+ 513us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1503591680}
I20260807 15:11:22.677929 1295 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:22.520285 1317 raft_consensus.cc:504] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:22.779948 29609 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.986s user 0.007s sys 0.043s
I20260807 15:11:22.783093 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0c51854d34430796b3dedd4548f4d5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.791826 29570 raft_consensus.cc:2379] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 8: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
I20260807 15:11:22.792176 29450 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:22.792554 29570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2374) took 2510 ms (client timeout 2127 ms). Trace:
W20260807 15:11:22.793323 29645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2863) took 3329 ms (client timeout 2167 ms). Trace:
W20260807 15:11:22.793923 29645 rpcz_store.cc:269] 0807 15:11:19.464132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.850009 (+385877us) service_pool.cc:227] Handling call
0807 15:11:22.792806 (+2942797us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54001c1454. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.793097 (+ 291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5082709376}
W20260807 15:11:22.794993 29646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59992 (request call id 2642) took 1737 ms (client timeout 1888 ms). Trace:
I20260807 15:11:22.789883 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1121) took 1793 ms. Trace:
I20260807 15:11:22.797266 29564 rpcz_store.cc:276] 0807 15:11:20.995333 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.123639 (+1128306us) service_pool.cc:227] Handling call
0807 15:11:22.783390 (+659751us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:22.774026 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 56073.9us
W20260807 15:11:22.793143 29570 rpcz_store.cc:269] 0807 15:11:20.282431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:20.282651 (+ 220us) service_pool.cc:227] Handling call
0807 15:11:22.777040 (+2494389us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800004598. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94d8ce0f11 00007f94d8e64b7c 00007f94d8e6473b 00007f94e1d54b09 00007f94e0c90730 00007f94e0d5679b 00007f94e0d56821 00007f94e0d061b0 00007f94e0d05a94 00007f94da3edc04 00007f94da3edb92
0807 15:11:22.792421 (+ 15381us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2642432}
W20260807 15:11:22.787495 30275 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.667s user 0.004s sys 0.024s
W20260807 15:11:22.798007 29609 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.111s user 0.008s sys 0.043s
I20260807 15:11:22.801180 29637 raft_consensus.cc:1226] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:22.795717 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:22.795630 29646 rpcz_store.cc:269] 0807 15:11:21.057615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.065569 (+ 7954us) service_pool.cc:227] Handling call
0807 15:11:22.794464 (+1728895us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54001bf8d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.794675 (+ 211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":502395776}
I20260807 15:11:22.783653 796 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:11:22.825637 30272 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.564s user 0.042s sys 0.082s
W20260807 15:11:22.798923 29647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59992 (request call id 2637) took 1742 ms (client timeout 1695 ms). Trace:
W20260807 15:11:22.798868 29642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2856) took 3571 ms (client timeout 3002 ms). Trace:
I20260807 15:11:22.798609 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:22.826856 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
W20260807 15:11:22.827070 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 514828us
W20260807 15:11:22.848785 30275 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.839s user 0.005s sys 0.024s
W20260807 15:11:22.850238 30272 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.635s user 0.045s sys 0.085s
I20260807 15:11:22.854813 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.842022 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d87368aeb34548079f36255279bee400" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
W20260807 15:11:22.845866 29642 rpcz_store.cc:269] 0807 15:11:19.213838 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.214004 (+ 166us) service_pool.cc:227] Handling call
0807 15:11:22.784820 (+3570816us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54003c7b54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.785114 (+ 294us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1056968960}
I20260807 15:11:22.800262 1317 leader_election.cc:288] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:22.859828 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:22.845420 29647 rpcz_store.cc:269] 0807 15:11:21.056190 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.056388 (+ 198us) service_pool.cc:227] Handling call
0807 15:11:22.796687 (+1740299us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540039f154. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.798702 (+ 2015us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2356224768}
I20260807 15:11:22.862035 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:22.865891 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 1.174e+06us
I20260807 15:11:22.872759 29480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55224 (request call id 1089) took 1024 ms. Trace:
I20260807 15:11:22.874061 29480 rpcz_store.cc:276] 0807 15:11:21.842760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.787203 (+944443us) service_pool.cc:227] Handling call
0807 15:11:22.866941 (+ 79738us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.783214 1295 raft_consensus.cc:504] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:22.875702 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2390) took 1808 ms. Trace:
I20260807 15:11:22.856455 1015 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:22.851583 1074 raft_consensus.cc:482] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:22.881130 29560 rpcz_store.cc:276] 0807 15:11:21.067276 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.789714 (+1722438us) service_pool.cc:227] Handling call
0807 15:11:22.875627 (+ 85913us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:22.880687 30309 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48584 (request call id 826) took 2385 ms (client timeout 1837 ms). Trace:
I20260807 15:11:22.799132 1264 raft_consensus.cc:504] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:22.853695 1334 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.895190 1282 raft_consensus.cc:3032] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:22.886279 29568 raft_consensus.cc:3037] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Advancing to term 6
I20260807 15:11:22.897709 29644 raft_consensus.cc:2379] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:22.886312 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.901476 29566 raft_consensus.cc:2379] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 7: Already voted for candidate 00dd11bf8fd9487580aba733c2996a4a in this term.
W20260807 15:11:22.899350 29449 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.736s user 0.005s sys 0.031s
I20260807 15:11:22.897212 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:22.899580 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45f04f91dc84b71b311beec0d34d756" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
W20260807 15:11:22.884625 30309 rpcz_store.cc:269] 0807 15:11:20.445036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:20.445169 (+ 133us) service_pool.cc:227] Handling call
0807 15:11:22.830065 (+2384896us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540076f054. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.830323 (+ 258us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":547087104}
I20260807 15:11:22.906028 1329 raft_consensus.cc:482] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
W20260807 15:11:22.906445 29367 catalog_manager.cc:4639] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet 81993fd783554e64b26c4f0c2344bf53 with cas_config_opid_index 3 failed: Not found: failed to reset TS proxy: No leader found: Tablet 81993fd783554e64b26c4f0c2344bf53 consensus state has no leader
W20260807 15:11:22.907727 29449 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.857s user 0.006s sys 0.031s
I20260807 15:11:22.887867 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:22.906921 1329 raft_consensus.cc:504] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.911036 1371 raft_consensus.cc:482] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:22.911337 1015 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.912015 1371 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:22.895824 1282 raft_consensus.cc:729] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:22.910120 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.918316 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18498fa007b248e9af1c1eaeee728541" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:22.919683 29570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2403) took 1102 ms. Trace:
I20260807 15:11:22.921043 29570 rpcz_store.cc:276] 0807 15:11:21.817540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.859102 (+1041562us) service_pool.cc:227] Handling call
0807 15:11:22.919616 (+ 60514us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:22.923751 29481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2384) took 2409 ms (client timeout 1791 ms). Trace:
I20260807 15:11:22.924471 1325 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:22.927526 1293 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:22.929417 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 3409) took 1403 ms. Trace:
I20260807 15:11:22.929838 29565 rpcz_store.cc:276] 0807 15:11:21.518083 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.807308 (+1289225us) service_pool.cc:227] Handling call
0807 15:11:22.920934 (+113626us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.932682 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3209) took 5285 ms. Trace:
W20260807 15:11:22.924329 29481 rpcz_store.cc:269] 0807 15:11:20.514407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:20.518661 (+ 4254us) service_pool.cc:227] Handling call
0807 15:11:22.923226 (+2404565us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b54001392d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.923521 (+ 295us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":66943232}
I20260807 15:11:22.913940 1334 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:22.921195 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:22.945403 29566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81993fd783554e64b26c4f0c2344bf53" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.943115 29488 raft_consensus.cc:2454] T 27275fe691bf4c42814ccca06801b625 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 6.
I20260807 15:11:22.952529 29488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2399) took 1195 ms. Trace:
I20260807 15:11:22.952877 29488 rpcz_store.cc:276] 0807 15:11:21.756727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.835858 (+1079131us) service_pool.cc:227] Handling call
0807 15:11:22.952462 (+116604us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.943671 29480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2406) took 1084 ms. Trace:
I20260807 15:11:22.939348 29646 raft_consensus.cc:2362] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10. Re-sending same reply.
I20260807 15:11:22.954037 29480 rpcz_store.cc:276] 0807 15:11:21.858862 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.884943 (+1026081us) service_pool.cc:227] Handling call
0807 15:11:22.943548 (+ 58605us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.933246 29483 rpcz_store.cc:276] 0807 15:11:17.643442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.994986 (+2351544us) service_pool.cc:227] Handling call
0807 15:11:19.995324 (+ 338us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.995521 (+ 197us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 15:11:20.272466 (+276945us) log.cc:842] Serialized 14 byte log entry
0807 15:11:22.927496 (+2655030us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b18003536e0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94dba5382c 00007f94d8e7e9dc 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e9be22 00007f94dba455bb 00007f94dba4b063 00007f94dba4b57b
0807 15:11:22.927929 (+ 433us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:22.928054 (+ 125us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:22.928155 (+ 101us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:22.928273 (+ 118us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:22.928471 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2569,"prepare.queue_time_us":516511,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":9784,"spinlock_wait_cycles":7528832,"thread_start_us":517257,"threads_started":2,"wal-append.queue_time_us":382978,"wal-append.run_cpu_time_us":1870,"wal-append.run_wall_time_us":1006147}
I20260807 15:11:22.956934 29565 raft_consensus.cc:1226] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:22.957814 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1109) took 2036 ms. Trace:
I20260807 15:11:22.958580 29483 raft_consensus.cc:1226] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:22.958209 29565 rpcz_store.cc:276] 0807 15:11:20.921079 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.938715 (+2017636us) service_pool.cc:227] Handling call
0807 15:11:22.956504 (+ 17789us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:22.957488 (+ 984us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:22.957717 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.927878 1325 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:22.961794 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:22.942545 1351 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:22.964248 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3230) took 1199 ms. Trace:
I20260807 15:11:22.968971 29483 rpcz_store.cc:276] 0807 15:11:21.760221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.957299 (+1197078us) service_pool.cc:227] Handling call
0807 15:11:22.958073 (+ 774us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:22.959154 (+ 1081us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:22.959359 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:22.964529 29486 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2395) took 1855 ms (client timeout 2174 ms). Trace:
I20260807 15:11:22.955054 29646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2873) took 1642 ms. Trace:
I20260807 15:11:22.968201 29565 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 15:11:22.970758 29646 rpcz_store.cc:276] 0807 15:11:21.312175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.862431 (+1550256us) service_pool.cc:227] Handling call
0807 15:11:22.954963 (+ 92532us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.971148 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59874 (request call id 3400) took 1987 ms. Trace:
I20260807 15:11:22.971612 29566 rpcz_store.cc:276] 0807 15:11:20.979704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.905043 (+1925339us) service_pool.cc:227] Handling call
0807 15:11:22.966838 (+ 61795us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.975795 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1111) took 2044 ms. Trace:
W20260807 15:11:22.969892 29486 rpcz_store.cc:269] 0807 15:11:21.093085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.351161 (+258076us) service_pool.cc:227] Handling call
0807 15:11:22.947727 (+1596566us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400064d54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.948056 (+ 329us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":966340352}
I20260807 15:11:22.977689 1334 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 15:11:22.978134 29486 raft_consensus.cc:1226] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:22.977820 29609 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:22.976274 29565 rpcz_store.cc:276] 0807 15:11:20.928523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.964870 (+2036347us) service_pool.cc:227] Handling call
0807 15:11:22.965703 (+ 833us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:22.970495 (+ 4792us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:22.972949 (+ 2454us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.976578 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:22.978530 1334 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:22.981917 1334 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:22.948128 1282 consensus_queue.cc:260] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:22.984074 30305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 827) took 2478 ms. Trace:
I20260807 15:11:22.984804 29483 raft_consensus.cc:1226] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:22.985347 1282 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:22.985654 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3232) took 1196 ms. Trace:
I20260807 15:11:22.985584 1306 raft_consensus.cc:482] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:22.986639 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:22.986230 29483 rpcz_store.cc:276] 0807 15:11:21.789560 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.975709 (+1186149us) service_pool.cc:227] Handling call
0807 15:11:22.984418 (+ 8709us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:22.985350 (+ 932us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:22.985582 (+ 232us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.988225 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3236) took 1168 ms. Trace:
I20260807 15:11:22.988657 29486 rpcz_store.cc:276] 0807 15:11:21.816092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.977404 (+1161312us) service_pool.cc:227] Handling call
0807 15:11:22.977923 (+ 519us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:22.978709 (+ 786us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:22.978986 (+ 277us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.984620 30305 rpcz_store.cc:276] 0807 15:11:20.505307 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:20.506330 (+ 1023us) service_pool.cc:227] Handling call
0807 15:11:20.511042 (+ 4712us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:20.511389 (+ 347us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:20.511420 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:20.511488 (+ 68us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:11:20.516715 (+ 5227us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.516846 (+ 131us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:22.983520 (+2466674us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b54008403d0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:22.983809 (+ 289us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":568,"raft.queue_time_us":2733,"raft.run_cpu_time_us":5775,"raft.run_wall_time_us":28049,"spinlock_wait_cycles":10051456}
I20260807 15:11:22.990132 29564 raft_consensus.cc:2454] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 11.
I20260807 15:11:22.987408 29640 raft_consensus.cc:2454] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 7.
I20260807 15:11:22.997035 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1125) took 1464 ms. Trace:
I20260807 15:11:22.997174 29640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2881) took 1467 ms. Trace:
I20260807 15:11:22.997408 29564 rpcz_store.cc:276] 0807 15:11:21.533006 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.859859 (+1326853us) service_pool.cc:227] Handling call
0807 15:11:22.996976 (+137117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.997593 29640 rpcz_store.cc:276] 0807 15:11:21.529717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.944951 (+1415234us) service_pool.cc:227] Handling call
0807 15:11:22.997100 (+ 52149us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:22.917326 1074 raft_consensus.cc:504] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:23.001986 1249 consensus_meta.cc:287] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.409s user 0.015s sys 0.014s
I20260807 15:11:22.998924 29560 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:22.978974 1329 leader_election.cc:288] T f4c7484fae4742a2a93ad8d15ee4241c P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
W20260807 15:11:23.019416 29479 consensus_meta.cc:287] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.811s user 0.015s sys 0.007s
I20260807 15:11:23.010272 1015 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.032529 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b6072ace00c943b19f41dba76504e780"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:23.036751 29479 raft_consensus.cc:2454] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:23.049481 1352 raft_consensus.cc:2726] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:23.057914 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1087) took 1215 ms. Trace:
I20260807 15:11:23.057996 29483 raft_consensus.cc:1226] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:23.058650 29486 rpcz_store.cc:276] 0807 15:11:21.842122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.001054 (+1158932us) service_pool.cc:227] Handling call
0807 15:11:23.043531 (+ 42477us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.054815 (+ 11284us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.054854 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.057634 (+ 2780us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:11:23.057667 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.057710 (+ 43us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.057840 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.053184 29480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2404) took 1286 ms. Trace:
I20260807 15:11:23.062124 29480 rpcz_store.cc:276] 0807 15:11:21.759854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.969755 (+1209901us) service_pool.cc:227] Handling call
0807 15:11:23.015775 (+ 46020us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.040905 (+ 25130us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.040953 (+ 48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.045709 (+ 4756us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:23.045767 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.045847 (+ 80us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.045999 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.063871 29479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2405) took 1222 ms. Trace:
I20260807 15:11:23.064558 29479 rpcz_store.cc:276] 0807 15:11:21.841806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.106563 (+264757us) service_pool.cc:227] Handling call
0807 15:11:23.056555 (+949992us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:23.071079 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 182267us
I20260807 15:11:23.052727 29646 raft_consensus.cc:595] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:23.076476 931 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:23.077123 917 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:23.077998 917 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:23.079921 29563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2376) took 2766 ms (client timeout 2880 ms). Trace:
I20260807 15:11:23.080485 917 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:23.080330 29563 rpcz_store.cc:269] 0807 15:11:20.313274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:20.313430 (+ 156us) service_pool.cc:227] Handling call
0807 15:11:23.079516 (+2766086us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54002ce7d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:23.079727 (+ 211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1542867200}
W20260807 15:11:23.077275 1118 consensus_meta.cc:287] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.265s user 0.018s sys 0.008s
I20260807 15:11:23.037511 1249 raft_consensus.cc:504] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.069685 1373 raft_consensus.cc:482] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:23.088730 1264 leader_election.cc:288] T 37e098505a6248f0aa9d91084fbbe64e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.074167 1306 raft_consensus.cc:504] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:23.094412 1353 consensus_meta.cc:287] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 1.030s user 0.006s sys 0.022s
W20260807 15:11:23.094805 1225 consensus_meta.cc:287] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198: Time spent flushing consensus metadata: real 1.087s user 0.013s sys 0.011s
I20260807 15:11:23.065289 1371 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.098048 29563 raft_consensus.cc:1226] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:23.103433 1371 raft_consensus.cc:482] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:23.105489 1260 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:23.106145 1371 raft_consensus.cc:504] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.106767 1260 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:23.108127 1340 consensus_meta.cc:287] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.763s user 0.004s sys 0.021s
I20260807 15:11:23.108803 1340 raft_consensus.cc:2726] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 15:11:23.109226 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 1.06011e+06us
I20260807 15:11:23.110507 1340 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:23.111459 29449 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:23.105455 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3399) took 2127 ms. Trace:
I20260807 15:11:23.112421 29646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40014 (request call id 48) took 1611 ms. Trace:
I20260807 15:11:23.114884 1260 leader_election.cc:288] T 1177fe2445db43e2b8366f33a841a041 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.117203 1144 consensus_queue.cc:1046] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:11:23.118906 29637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35570 (request call id 918) took 1924 ms. Trace:
I20260807 15:11:23.119922 29481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2401) took 1362 ms. Trace:
I20260807 15:11:23.121856 29486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55224 (request call id 1090) took 1278 ms. Trace:
I20260807 15:11:23.140401 29646 rpcz_store.cc:276] 0807 15:11:21.501288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.974356 (+1473068us) service_pool.cc:227] Handling call
0807 15:11:23.112307 (+137951us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.108851 1377 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.141752 29486 rpcz_store.cc:276] 0807 15:11:21.842975 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.060645 (+1217670us) service_pool.cc:227] Handling call
0807 15:11:23.121336 (+ 60691us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.121636 (+ 300us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.121650 (+ 14us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.121694 (+ 44us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:23.121711 (+ 17us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.121746 (+ 35us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.121813 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":420224}
I20260807 15:11:23.145898 958 leader_election.cc:288] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.122042 29485 raft_consensus.cc:2454] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:23.122427 1325 leader_election.cc:288] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:23.083824 1295 leader_election.cc:288] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.122483 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:23.124315 998 consensus_meta.cc:287] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 1.159s user 0.009s sys 0.016s
I20260807 15:11:23.095055 1306 leader_election.cc:288] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.125844 1371 leader_election.cc:288] T 0a0ef49386d543e6bf09732d79976e83 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.125900 1074 leader_election.cc:288] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:23.126929 29569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60682 (request call id 1115) took 2196 ms (client timeout 2170 ms). Trace:
I20260807 15:11:23.127434 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.133553 29561 raft_consensus.cc:1226] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 9. Current term is 10. Ops: []
I20260807 15:11:23.134099 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.140311 29563 rpcz_store.cc:276] 0807 15:11:20.978491 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.081353 (+2102862us) service_pool.cc:227] Handling call
0807 15:11:23.081816 (+ 463us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.105075 (+ 23259us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.105390 (+ 315us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.089090 1373 raft_consensus.cc:504] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.140913 29637 rpcz_store.cc:276] 0807 15:11:21.194405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.196107 (+ 1702us) service_pool.cc:227] Handling call
0807 15:11:22.800439 (+1604332us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:22.856102 (+ 55663us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.118657 (+262555us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540039f150. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:23.118815 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3644073216}
I20260807 15:11:23.161856 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3401) took 2177 ms. Trace:
I20260807 15:11:23.143656 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
W20260807 15:11:23.144685 1280 consensus_meta.cc:287] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.881s user 0.012s sys 0.011s
I20260807 15:11:23.154541 1144 raft_consensus.cc:3032] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:23.154731 998 raft_consensus.cc:504] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:23.155236 29638 consensus_meta.cc:287] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270: Time spent flushing consensus metadata: real 0.552s user 0.013s sys 0.003s
I20260807 15:11:23.095373 1353 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:23.141400 29481 rpcz_store.cc:276] 0807 15:11:21.757485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.966265 (+1208780us) service_pool.cc:227] Handling call
0807 15:11:22.994197 (+ 27932us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:22.994671 (+ 474us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:22.994699 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 15:11:22.995390 (+ 691us) log.cc:842] Serialized 26 byte log entry
0807 15:11:23.057619 (+ 62229us) raft_consensus.cc:1631] Marking committed up to 8
0807 15:11:23.057651 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.057723 (+ 72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:23.119660 (+ 61937us) raft_consensus.cc:1671] finished
0807 15:11:23.119689 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.119828 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":61785,"threads_started":1,"wal-append.queue_time_us":120555}
I20260807 15:11:23.154511 29645 raft_consensus.cc:2454] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:23.162482 29646 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 10.
I20260807 15:11:23.162544 29640 raft_consensus.cc:1226] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:23.168632 29645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59992 (request call id 2652) took 1908 ms. Trace:
I20260807 15:11:23.169009 29645 rpcz_store.cc:276] 0807 15:11:21.260193 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.122120 (+1861927us) service_pool.cc:227] Handling call
0807 15:11:23.168578 (+ 46458us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:23.159583 29569 rpcz_store.cc:269] 0807 15:11:20.932526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.548362 (+615836us) service_pool.cc:227] Handling call
0807 15:11:23.126750 (+1578388us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400318dd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:23.126864 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2352179072}
I20260807 15:11:23.162223 29561 rpcz_store.cc:276] 0807 15:11:20.984302 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.132791 (+2148489us) service_pool.cc:227] Handling call
0807 15:11:23.133164 (+ 373us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.159949 (+ 26785us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.161800 (+ 1851us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.170979 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.167578 29638 raft_consensus.cc:2454] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10.
I20260807 15:11:23.095580 1225 raft_consensus.cc:504] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.179047 29561 raft_consensus.cc:1226] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:23.178913 29531 leader_election.cc:302] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:23.176368 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4c7484fae4742a2a93ad8d15ee4241c" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.180313 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f248aa577ff4c798c99df5834ea66e5" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.182520 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.143885 1377 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.184167 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3405) took 2189 ms. Trace:
I20260807 15:11:23.185983 29561 rpcz_store.cc:276] 0807 15:11:20.994737 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.172325 (+2177588us) service_pool.cc:227] Handling call
0807 15:11:23.178855 (+ 6530us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.181059 (+ 2204us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.184107 (+ 3048us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.176851 30272 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:23.179672 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.166180 1144 raft_consensus.cc:729] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.177246 29640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2880) took 1642 ms. Trace:
I20260807 15:11:23.188714 29640 rpcz_store.cc:276] 0807 15:11:21.529350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.014495 (+1485145us) service_pool.cc:227] Handling call
0807 15:11:23.073369 (+ 58874us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.171956 (+ 98587us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.172147 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.112112 1340 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.175797 1371 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:23.098994 1118 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.185357 29570 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 9.
I20260807 15:11:23.193673 30307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48584 (request call id 840) took 1606 ms. Trace:
I20260807 15:11:23.194482 30305 raft_consensus.cc:1226] T 8f248aa577ff4c798c99df5834ea66e5 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:23.194557 29561 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260807 15:11:23.194885 29487 raft_consensus.cc:2379] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 9: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:23.195680 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3406) took 2188 ms. Trace:
I20260807 15:11:23.196568 29561 rpcz_store.cc:276] 0807 15:11:21.007561 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.186770 (+2179209us) service_pool.cc:227] Handling call
0807 15:11:23.194111 (+ 7341us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 15:11:23.195273 (+ 1162us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.195597 (+ 324us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:23.202224 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 90903.6us
I20260807 15:11:23.199373 29637 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6a9409698ac457faa20f77f1cf661a7"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:23.203212 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.201851 29647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2877) took 1710 ms. Trace:
I20260807 15:11:23.204824 29647 rpcz_store.cc:276] 0807 15:11:21.491087 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.163814 (+1672727us) service_pool.cc:227] Handling call
0807 15:11:23.201777 (+ 37963us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.202943 29637 raft_consensus.cc:595] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:23.209789 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.170786 1280 raft_consensus.cc:504] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.214880 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.216361 29486 raft_consensus.cc:2379] T 3a1d390489b54758a0ce36af133f1d57 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 6: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:23.217289 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.219998 29644 raft_consensus.cc:1226] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:23.194151 30307 rpcz_store.cc:276] 0807 15:11:21.583051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.583196 (+ 145us) service_pool.cc:227] Handling call
0807 15:11:21.592555 (+ 9359us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 15:11:21.597764 (+ 5209us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:21.597804 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 15:11:21.617393 (+ 19589us) log.cc:842] Serialized 52 byte log entry
0807 15:11:22.994292 (+1376899us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b18004709e0. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94e1d3b8b1 00007f94e1d48661 00007f94d8e7e345 00007f94e1cb5a39 00007f94d8e9b8bb 00007f94d8e99cbf 00007f94d8e9be22 00007f94dba455bb 00007f94dba4b063 00007f94dba4b411 00007f94dbd985cf
0807 15:11:23.082325 (+ 88033us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:23.082411 (+ 86us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.082508 (+ 97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:23.179620 (+ 97112us) raft_consensus.cc:1671] finished
0807 15:11:23.179649 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.189727 (+ 10078us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24707,"raft.queue_time_us":11367,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":13636,"spinlock_wait_cycles":12365056,"thread_start_us":78031,"threads_started":1,"wal-append.queue_time_us":1535518}
I20260807 15:11:23.221946 29452 leader_election.cc:302] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:23.212812 1353 raft_consensus.cc:2781] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:23.223168 1353 raft_consensus.cc:482] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:23.223637 1353 raft_consensus.cc:3037] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:23.225190 29644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59988 (request call id 2882) took 1690 ms. Trace:
I20260807 15:11:23.225587 29644 rpcz_store.cc:276] 0807 15:11:21.530010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.192125 (+1662115us) service_pool.cc:227] Handling call
0807 15:11:23.219797 (+ 27672us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.220320 (+ 523us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.220462 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.198115 1334 raft_consensus.cc:504] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.233947 1351 raft_consensus.cc:2726] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:23.234624 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.235271 29641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35570 (request call id 927) took 1187 ms. Trace:
I20260807 15:11:23.235705 30305 raft_consensus.cc:2396] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260807 15:11:23.236202 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "990a0811150c4c53ae50cc69c71f2926" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.237051 30307 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:23.236797 1144 consensus_queue.cc:260] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.237040 1153 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:23.238880 1144 raft_consensus.cc:3037] T b1d288f694924e79826a10fc7cff8351 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:23.238724 1153 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.235656 29641 rpcz_store.cc:276] 0807 15:11:22.039753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.223872 (+1184119us) service_pool.cc:227] Handling call
0807 15:11:23.224355 (+ 483us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.224590 (+ 235us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.224613 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.224689 (+ 76us) raft_consensus.cc:1631] Marking committed up to 10
0807 15:11:23.224734 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.224808 (+ 74us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.226938 (+ 2130us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.240552 30311 raft_consensus.cc:1261] T 00c48154e8c94a9c83e606db06e22092 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 15:11:20.561635 29567 rpcz_store.cc:276] 0807 15:11:18.732943 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:19.822987 (+1090044us) service_pool.cc:227] Handling call
0807 15:11:19.823405 (+ 418us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:19.823640 (+ 235us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 15:11:19.850434 (+ 26794us) log.cc:842] Serialized 14 byte log entry
0807 15:11:20.556434 (+706000us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:20.556489 (+ 55us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:20.556543 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:20.556614 (+ 71us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:20.556725 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":66349,"prepare.queue_time_us":27070,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":11549,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5911,"thread_start_us":694416,"threads_started":1}
I20260807 15:11:23.241803 1118 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.242952 30311 raft_consensus.cc:1226] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:23.243064 29567 raft_consensus.cc:1226] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:23.237528 1333 raft_consensus.cc:482] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:23.246026 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3403) took 2241 ms. Trace:
W20260807 15:11:23.246059 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 48874.9us
I20260807 15:11:23.246483 29569 rpcz_store.cc:276] 0807 15:11:20.989118 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.171656 (+2182538us) service_pool.cc:227] Handling call
0807 15:11:23.172067 (+ 411us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.227086 (+ 55019us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.227122 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.230312 (+ 3190us) raft_consensus.cc:1631] Marking committed up to 6
0807 15:11:23.230351 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.230409 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.230546 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.245286 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1124) took 2192 ms. Trace:
I20260807 15:11:23.247395 29567 rpcz_store.cc:276] 0807 15:11:21.051772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.242361 (+2190589us) service_pool.cc:227] Handling call
0807 15:11:23.242749 (+ 388us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.243523 (+ 774us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.243683 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.244729 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.230716 1375 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.262055 29641 raft_consensus.cc:1261] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260807 15:11:23.254120 29481 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 10.
I20260807 15:11:23.260901 29560 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:23.261698 29569 raft_consensus.cc:1226] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:23.267503 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3408) took 1760 ms. Trace:
I20260807 15:11:23.270546 29569 rpcz_store.cc:276] 0807 15:11:21.506930 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.258746 (+1751816us) service_pool.cc:227] Handling call
0807 15:11:23.259255 (+ 509us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.266351 (+ 7096us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.267441 (+ 1090us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.265158 29641 pending_rounds.cc:76] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270: Aborting all ops after (but not including) 5
I20260807 15:11:23.272001 1375 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.274295 1249 leader_election.cc:288] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.274621 1375 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.277223 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.278005 30306 raft_consensus.cc:1226] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260807 15:11:23.279106 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.280481 30303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.281322 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3410) took 1756 ms. Trace:
I20260807 15:11:23.281741 29567 rpcz_store.cc:276] 0807 15:11:21.525035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.247857 (+1722822us) service_pool.cc:227] Handling call
0807 15:11:23.280727 (+ 32870us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.280977 (+ 250us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.280999 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.281035 (+ 36us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:23.281061 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.281117 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.281231 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.283339 998 leader_election.cc:288] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.283862 29561 raft_consensus.cc:1226] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:23.284456 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574818cf180d48a68d8b72da65c22af5" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.284601 29561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3407) took 2256 ms. Trace:
I20260807 15:11:23.286988 29561 rpcz_store.cc:276] 0807 15:11:21.028090 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.201967 (+2173877us) service_pool.cc:227] Handling call
0807 15:11:23.246182 (+ 44215us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.284327 (+ 38145us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.284526 (+ 199us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.287830 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f07d982710354dfca721e4641d589839" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.288234 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:23.289052 29561 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:23.291471 29564 raft_consensus.cc:1226] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: []
W20260807 15:11:23.289156 30272 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 126804us
I20260807 15:11:23.292186 29564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1112) took 2363 ms. Trace:
I20260807 15:11:23.292591 30272 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:23.292546 29564 rpcz_store.cc:276] 0807 15:11:20.928868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.290688 (+2361820us) service_pool.cc:227] Handling call
0807 15:11:23.291147 (+ 459us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.291921 (+ 774us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.292118 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:23.294018 1381 log.cc:924] Time spent T b6072ace00c943b19f41dba76504e780 P 00dd11bf8fd9487580aba733c2996a4a: Append to log took a long time: real 0.140s user 0.000s sys 0.003s
I20260807 15:11:23.294263 30272 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:23.295850 1102 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:23.296149 678 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 15:11:23.296667 678 raft_consensus.cc:482] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bbe5c211ab64989a57350f34f007ced)
I20260807 15:11:23.296921 1361 consensus_queue.cc:1046] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 15:11:23.297768 678 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:23.298880 1361 raft_consensus.cc:3032] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:23.299273 1361 raft_consensus.cc:729] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.279430 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1d390489b54758a0ce36af133f1d57" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.281589 30303 raft_consensus.cc:2379] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced in current term 5: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
W20260807 15:11:23.289816 29482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2388) took 2233 ms (client timeout 1935 ms). Trace:
I20260807 15:11:23.301229 30306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:23.301525 29482 rpcz_store.cc:269] 0807 15:11:21.056149 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.057379 (+ 1230us) service_pool.cc:227] Handling call
0807 15:11:23.289412 (+2232033us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54000d2854. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:23.289624 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1305676032}
I20260807 15:11:23.262324 1329 raft_consensus.cc:2781] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 15:11:23.303073 1329 raft_consensus.cc:686] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.303109 1361 consensus_queue.cc:260] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.304780 1361 raft_consensus.cc:3037] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:23.305234 30307 raft_consensus.cc:2454] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 11.
I20260807 15:11:23.304512 1329 consensus_queue.cc:237] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:23.306337 1357 consensus_meta.cc:287] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced: Time spent flushing consensus metadata: real 0.609s user 0.015s sys 0.000s
I20260807 15:11:23.306306 30304 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260807 15:11:23.274389 1153 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.293923 29564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:23.283529 29567 raft_consensus.cc:1226] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:23.307973 29646 raft_consensus.cc:1261] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 15:11:23.271481 29641 pending_rounds.cc:97] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260807 15:11:23.312201 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 51949.7us
I20260807 15:11:23.318886 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1127) took 1754 ms. Trace:
W20260807 15:11:23.313717 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 473135us
I20260807 15:11:23.319312 29567 rpcz_store.cc:276] 0807 15:11:21.564432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.282857 (+1718425us) service_pool.cc:227] Handling call
0807 15:11:23.283339 (+ 482us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.318584 (+ 35245us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.318824 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.325125 29640 raft_consensus.cc:1261] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 15:11:23.326341 29640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59992 (request call id 2661) took 1652 ms. Trace:
I20260807 15:11:23.328040 29560 raft_consensus.cc:1226] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:23.328632 29481 raft_consensus.cc:1226] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 5. Current term is 6. Ops: []
I20260807 15:11:23.328953 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3411) took 1803 ms. Trace:
I20260807 15:11:23.329448 29637 raft_consensus.cc:1226] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 9. Current term is 10. Ops: []
I20260807 15:11:23.326836 29640 rpcz_store.cc:276] 0807 15:11:21.674104 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.192158 (+1518054us) service_pool.cc:227] Handling call
0807 15:11:23.227502 (+ 35344us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.326015 (+ 98513us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.326275 (+ 260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.327082 29641 raft_consensus.cc:2866] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:11:23.329478 29560 rpcz_store.cc:276] 0807 15:11:21.525389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.270181 (+1744792us) service_pool.cc:227] Handling call
0807 15:11:23.320419 (+ 50238us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.328640 (+ 8221us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.328887 (+ 247us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.283437 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:23.332442 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 156421us
I20260807 15:11:23.334698 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b67938f915c84df3a2da7adba02b898b" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.343151 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9b0eecfdf5242a3b82bc6217faa4b96" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.344853 29644 raft_consensus.cc:1261] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260807 15:11:23.318639 1371 raft_consensus.cc:2781] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:23.353655 30305 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260807 15:11:23.359500 1318 leader_election.cc:288] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:23.363229 1377 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.364341 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1114) took 2434 ms. Trace:
I20260807 15:11:23.364849 29565 raft_consensus.cc:1226] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:23.368126 29567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:23.308408 1333 raft_consensus.cc:504] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.372759 29484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44122 (request call id 2389) took 2310 ms. Trace:
I20260807 15:11:23.373905 29643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35570 (request call id 916) took 2180 ms. Trace:
I20260807 15:11:23.375535 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.332450 1373 leader_election.cc:288] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
W20260807 15:11:23.381134 29452 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 47340.2us
I20260807 15:11:23.382076 29569 raft_consensus.cc:1261] T acc305388a594a0f8be8d24006e0b323 P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260807 15:11:23.384516 29646 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd"
dest_uuid: "4b092f7f951b4137b5d7810056684270"
mode: GRACEFUL
new_leader_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:40014
I20260807 15:11:23.389114 29483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3237) took 1563 ms. Trace:
I20260807 15:11:23.406248 29646 raft_consensus.cc:595] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Received request to transfer leadership to TS 00dd11bf8fd9487580aba733c2996a4a
I20260807 15:11:23.389601 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.391466 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3398) took 2416 ms. Trace:
I20260807 15:11:23.390619 29566 rpcz_store.cc:276] 0807 15:11:20.930091 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.363184 (+2433093us) service_pool.cc:227] Handling call
0807 15:11:23.363655 (+ 471us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.364009 (+ 354us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.364036 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.364076 (+ 40us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:23.364106 (+ 30us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.364159 (+ 53us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.364275 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 15:11:23.349226 1350 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s user 0.019s sys 0.016s
I20260807 15:11:23.408025 29565 rpcz_store.cc:276] 0807 15:11:20.975162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.364253 (+2389091us) service_pool.cc:227] Handling call
0807 15:11:23.364629 (+ 376us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.391145 (+ 26516us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.391399 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.400209 29484 rpcz_store.cc:276] 0807 15:11:21.061959 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.062393 (+ 434us) service_pool.cc:227] Handling call
0807 15:11:22.715996 (+1653603us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:22.744902 (+ 28906us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.372538 (+627636us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54001b4750. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc3a09 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:23.372688 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3750830976}
I20260807 15:11:23.400456 29643 rpcz_store.cc:276] 0807 15:11:21.193634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.193761 (+ 127us) service_pool.cc:227] Handling call
0807 15:11:21.217641 (+ 23880us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:21.676151 (+458510us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:21.676188 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:21.676241 (+ 53us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:21.676297 (+ 56us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.373410 (+1697113us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54002da854. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:23.373472 (+ 62us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.373673 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1053860224}
I20260807 15:11:23.403227 29568 raft_consensus.cc:2454] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 6.
I20260807 15:11:23.406042 29483 rpcz_store.cc:276] 0807 15:11:21.817582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.000555 (+1182973us) service_pool.cc:227] Handling call
0807 15:11:23.046572 (+ 46017us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.066702 (+ 20130us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.380664 (+313962us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b54003acfd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:23.380919 (+ 255us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10405760}
I20260807 15:11:23.409420 998 consensus_queue.cc:1035] T 00c48154e8c94a9c83e606db06e22092 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:23.410241 1249 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:23.410948 30309 raft_consensus.cc:1226] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:23.406774 30312 raft_consensus.cc:1226] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:23.411175 1342 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.412009 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2402) took 1594 ms. Trace:
I20260807 15:11:23.411871 1342 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.412030 1225 leader_election.cc:288] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 4 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.414247 1342 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.414474 30308 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 13.
I20260807 15:11:23.416985 29642 raft_consensus.cc:2396] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bbe5c211ab64989a57350f34f007ced for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260807 15:11:23.417462 29642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2884) took 1886 ms. Trace:
I20260807 15:11:23.417750 29642 rpcz_store.cc:276] 0807 15:11:21.530639 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.375176 (+1844537us) service_pool.cc:227] Handling call
0807 15:11:23.417401 (+ 42225us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.404626 29609 leader_election.cc:302] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
W20260807 15:11:23.389261 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 67816.2us
I20260807 15:11:23.410431 30310 raft_consensus.cc:1226] T 2fe1df4603dd4ecdad74103a84926118 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:23.412410 29567 rpcz_store.cc:276] 0807 15:11:21.817179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.410933 (+1593754us) service_pool.cc:227] Handling call
0807 15:11:23.411354 (+ 421us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.411634 (+ 280us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.411658 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.411704 (+ 46us) raft_consensus.cc:1631] Marking committed up to 7
0807 15:11:23.411745 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.411809 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.411951 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.336269 1357 raft_consensus.cc:482] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:23.419015 29449 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:23.421664 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3412) took 1873 ms. Trace:
W20260807 15:11:23.420686 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 136823us
I20260807 15:11:23.424645 29568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59890 (request call id 2404) took 1445 ms. Trace:
I20260807 15:11:23.428580 29569 rpcz_store.cc:276] 0807 15:11:21.533486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.271337 (+1737851us) service_pool.cc:227] Handling call
0807 15:11:23.339637 (+ 68300us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.405513 (+ 65876us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.407311 (+ 1798us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.399223 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:23.429060 29488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 3233) took 1635 ms. Trace:
W20260807 15:11:23.418962 1350 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s user 0.019s sys 0.017s
I20260807 15:11:23.426384 678 raft_consensus.cc:504] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.428906 29568 rpcz_store.cc:276] 0807 15:11:21.978889 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.769658 (+790769us) service_pool.cc:227] Handling call
0807 15:11:23.424244 (+654586us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.401597 1340 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.437259 29568 raft_consensus.cc:1226] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 3. Current term is 4. Ops: []
I20260807 15:11:23.437317 29561 raft_consensus.cc:2454] T e9b0eecfdf5242a3b82bc6217faa4b96 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:23.431701 30274 leader_election.cc:302] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:23.418331 1353 raft_consensus.cc:504] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.430938 29488 rpcz_store.cc:276] 0807 15:11:21.793939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.976688 (+1182749us) service_pool.cc:227] Handling call
0807 15:11:23.037991 (+ 61303us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.087815 (+ 49824us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 15:11:23.269106 (+181291us) log.cc:842] Serialized 14 byte log entry
0807 15:11:23.428721 (+159615us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.428778 (+ 57us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:23.428824 (+ 46us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.428892 (+ 68us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.429007 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":170135,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":56,"thread_start_us":124069,"threads_started":2}
I20260807 15:11:23.442387 1225 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260807 15:11:23.450521 29563 raft_consensus.cc:1226] T b45f04f91dc84b71b311beec0d34d756 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:23.446586 1373 raft_consensus.cc:2726] T d87368aeb34548079f36255279bee400 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:23.460773 1334 leader_election.cc:288] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.441169 1371 raft_consensus.cc:686] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 6 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:23.462411 1288 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.463070 1288 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.463522 1371 consensus_queue.cc:237] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.464494 29566 raft_consensus.cc:1226] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:23.451866 1293 consensus_queue.cc:1035] T 6deeb6ab1b13402e953266974f24e09d P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260807 15:11:23.465276 29566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1128) took 1883 ms. Trace:
I20260807 15:11:23.465641 29566 rpcz_store.cc:276] 0807 15:11:21.581756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.408456 (+1826700us) service_pool.cc:227] Handling call
0807 15:11:23.453968 (+ 45512us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.464999 (+ 11031us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.465216 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.410984 1249 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.467038 29566 raft_consensus.cc:1226] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:23.468348 1249 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.468482 1145 consensus_queue.cc:1046] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:23.469415 1314 raft_consensus.cc:482] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:23.469890 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 82273.3us
I20260807 15:11:23.470099 1314 raft_consensus.cc:504] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.470749 29449 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:11:23.472061 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 73404.3us
I20260807 15:11:23.452752 1357 raft_consensus.cc:504] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.473961 1334 consensus_queue.cc:1046] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 15:11:23.475356 1334 raft_consensus.cc:3032] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:23.475745 1334 raft_consensus.cc:729] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.475816 1376 consensus_queue.cc:1046] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 9.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260807 15:11:23.477276 1376 raft_consensus.cc:3032] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 15:11:23.477715 1376 raft_consensus.cc:729] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.475364 29609 leader_election.cc:302] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:23.478214 1340 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader election won for term 10
I20260807 15:11:23.478824 1373 raft_consensus.cc:2781] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader election won for term 11
I20260807 15:11:23.478871 1376 consensus_queue.cc:260] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 9.12, Last appended by leader: 12, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.479513 1373 raft_consensus.cc:686] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 11 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.479627 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.479948 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.480872 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.488629 29560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3415) took 1376 ms. Trace:
W20260807 15:11:23.482110 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 61464.9us
I20260807 15:11:23.482630 1351 raft_consensus.cc:2781] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:23.493412 1351 raft_consensus.cc:482] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:23.493521 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.493822 1351 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:23.446111 1280 leader_election.cc:288] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.485126 678 leader_election.cc:288] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.453397 1153 raft_consensus.cc:3037] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:23.503697 29563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3402) took 2517 ms. Trace:
I20260807 15:11:23.504145 29563 rpcz_store.cc:276] 0807 15:11:20.986661 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.160272 (+2173611us) service_pool.cc:227] Handling call
0807 15:11:23.186187 (+ 25915us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.456368 (+270181us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.503441 (+ 47073us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002ce7d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:23.503615 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":591529856}
W20260807 15:11:23.505717 29487 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2400) took 1748 ms (client timeout 1865 ms). Trace:
W20260807 15:11:23.506198 29487 rpcz_store.cc:269] 0807 15:11:21.756983 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.766208 (+ 9225us) service_pool.cc:227] Handling call
0807 15:11:23.505474 (+1739266us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001829d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:23.505655 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3269452032}
I20260807 15:11:23.507171 29567 raft_consensus.cc:1226] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 10. Current term is 11. Ops: []
I20260807 15:11:23.486294 1031 consensus_queue.cc:1046] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:11:23.508080 29567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60682 (request call id 1129) took 1683 ms. Trace:
I20260807 15:11:23.508567 29567 rpcz_store.cc:276] 0807 15:11:21.825381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.445107 (+1619726us) service_pool.cc:227] Handling call
0807 15:11:23.506795 (+ 61688us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.507751 (+ 956us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.508011 (+ 260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.512127 1295 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.512480 1333 leader_election.cc:288] T 62050f8fd36a4c19bd25be548475deb7 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.512809 1295 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.513594 29637 raft_consensus.cc:2454] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 10.
W20260807 15:11:23.514377 29485 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44122 (request call id 2403) took 1755 ms (client timeout 2148 ms). Trace:
I20260807 15:11:23.514632 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.514994 1295 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.491062 29642 raft_consensus.cc:2379] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 5: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:23.515326 29637 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Advancing to term 11
W20260807 15:11:23.514912 29485 rpcz_store.cc:269] 0807 15:11:21.759510 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:22.664353 (+904843us) service_pool.cc:227] Handling call
0807 15:11:23.514175 (+849822us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54003ae8d4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:23.514308 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":885584128}
I20260807 15:11:23.491190 29643 raft_consensus.cc:2396] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260807 15:11:23.481799 1357 leader_election.cc:288] T 1fc8adcf9402487ca81d7c0edc5dd599 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:23.448750 29450 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.144.194:33589 timed out after 2.134s (SENT) [suppressed 37 similar messages]
W20260807 15:11:23.531168 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 85866.8us
I20260807 15:11:23.491559 29560 rpcz_store.cc:276] 0807 15:11:22.111310 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.431198 (+1319888us) service_pool.cc:227] Handling call
0807 15:11:23.486576 (+ 55378us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.487015 (+ 439us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.487040 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.487083 (+ 43us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:23.487116 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.487175 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.487284 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.532289 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:23.500520 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.488807 29569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59890 (request call id 2407) took 1437 ms. Trace:
I20260807 15:11:23.533187 29569 rpcz_store.cc:276] 0807 15:11:22.051617 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.429880 (+1378263us) service_pool.cc:227] Handling call
0807 15:11:23.455931 (+ 26051us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.488416 (+ 32485us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.488444 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.488482 (+ 38us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:23.488567 (+ 85us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.488632 (+ 65us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.488747 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 15:11:23.516270 29479 raft_consensus.cc:1226] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:23.517684 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:23.518741 29638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59988 (request call id 2874) took 2175 ms (client timeout 1595 ms). Trace:
I20260807 15:11:23.520234 1280 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.478886 1340 raft_consensus.cc:686] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Becoming Leader. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:23.523691 1293 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:23.483232 29449 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:23.476866 1334 consensus_queue.cc:260] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
W20260807 15:11:23.534981 29638 rpcz_store.cc:269] 0807 15:11:21.343030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:21.350505 (+ 7475us) service_pool.cc:227] Handling call
0807 15:11:23.518513 (+2168008us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002dbc54. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc82ae 00007f94e0d05c27 00007f94da3edc04 00007f94da3edb92 00007f94da3edac1 00007f94da3eda3c 00007f94da3eccf2 00007f94da1ee94c 00007f94da1edd86 00007f94da1ed72f
0807 15:11:23.518650 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2864268160}
I20260807 15:11:23.539326 29640 raft_consensus.cc:1226] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 7. Current term is 8. Ops: []
I20260807 15:11:23.490454 1249 raft_consensus.cc:482] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:23.544430 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 52199us
I20260807 15:11:23.532065 1350 raft_consensus.cc:482] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.546929 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7645f7cacdb34a1486686ba6f848e1bb" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.552193 29486 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 9.
I20260807 15:11:23.544741 1280 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.554100 1171 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260807 15:11:23.554704 1334 raft_consensus.cc:3037] T 8f248aa577ff4c798c99df5834ea66e5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:23.556581 1280 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.557466 1293 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.560820 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.550329 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe1df4603dd4ecdad74103a84926118" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.526409 1373 consensus_queue.cc:237] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.567493 29609 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:23.568645 1102 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.575083 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.576670 678 consensus_queue.cc:1046] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 15:11:23.566231 1246 consensus_queue.cc:1035] T 5fd4d41c286445e997322bdb49e97c65 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260807 15:11:23.578312 29485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.561077 1144 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 15:11:23.582708 30311 raft_consensus.cc:2454] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 6.
I20260807 15:11:23.567130 1376 raft_consensus.cc:3037] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 9 FOLLOWER]: Advancing to term 10
W20260807 15:11:23.545831 982 consensus_queue.cc:1159] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9bbe5c211ab64989a57350f34f007ced" responder_term: 9 status { last_received { term: 9 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 9 index: 12 } }
I20260807 15:11:23.583292 1144 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:23.588856 1144 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:23.563232 1371 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 9bbe5c211ab64989a57350f34f007ced [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:11:23.591368 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.594246 678 raft_consensus.cc:3032] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:23.594683 678 raft_consensus.cc:729] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.577605 1074 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260807 15:11:23.595361 1074 raft_consensus.cc:482] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:23.595436 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.595851 1074 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 13 FOLLOWER]: Advancing to term 14
I20260807 15:11:23.569515 1353 leader_election.cc:288] T c8cd23e547af4b6eb4c91c08c1ce7d9a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Requested vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.596662 29647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59992 (request call id 2667) took 1821 ms. Trace:
I20260807 15:11:23.569257 1102 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.581770 1314 leader_election.cc:288] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.565286 1171 consensus_queue.cc:1046] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260807 15:11:23.565500 1249 raft_consensus.cc:504] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.549863 1350 raft_consensus.cc:504] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.605628 29450 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
W20260807 15:11:23.606402 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 123273us
I20260807 15:11:23.609138 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.605712 1319 consensus_queue.cc:1046] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260807 15:11:23.609166 29565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59874 (request call id 3414) took 1939 ms. Trace:
I20260807 15:11:23.610888 29565 rpcz_store.cc:276] 0807 15:11:21.670282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.412123 (+1741841us) service_pool.cc:227] Handling call
0807 15:11:23.412506 (+ 383us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 15:11:23.469251 (+ 56745us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.469283 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 15:11:23.469326 (+ 43us) raft_consensus.cc:1631] Marking committed up to 4
0807 15:11:23.469357 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.608917 (+139560us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54001cbbd4. stack: 00007f94d8e6a033 00007f94d8e69f30 00007f94d87c8534 00007f94e24d48b4 00007f94e24d4849 00007f94dbd49471 00007f94dbdc4f51 00007f94dbdc399e 00007f94e0d052e9 00007f94da3eb684 00007f94da3eb612 00007f94da3eb541 00007f94da3eb4bc 00007f94da3ea772 00007f94da1ee94c 00007f94da1edd86
0807 15:11:23.608974 (+ 57us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.609109 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":129833216}
I20260807 15:11:23.593665 1293 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.611963 29644 raft_consensus.cc:3032] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:23.613236 30308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.598212 29647 rpcz_store.cc:276] 0807 15:11:21.775768 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.209118 (+1433350us) service_pool.cc:227] Handling call
0807 15:11:23.225414 (+ 16296us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 15:11:23.265101 (+ 39687us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.265151 (+ 50us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 15:11:23.292223 (+ 27072us) log.cc:842] Serialized 52 byte log entry
0807 15:11:23.406643 (+114420us) raft_consensus.cc:1631] Marking committed up to 3
0807 15:11:23.406704 (+ 61us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.406791 (+ 87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:23.596440 (+189649us) raft_consensus.cc:1671] finished
0807 15:11:23.596459 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.596600 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1368,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":17506,"thread_start_us":113814,"threads_started":1,"wal-append.queue_time_us":254740}
I20260807 15:11:23.620791 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.619637 29644 raft_consensus.cc:729] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.620798 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:23.611627 1350 leader_election.cc:288] T ca67c90d21974f08892e272b90a83ac0 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.622151 30307 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:23.625387 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.604790 1353 raft_consensus.cc:482] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.626940 678 consensus_queue.cc:260] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.631269 28227 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 15:11:23.633782 678 raft_consensus.cc:3037] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:23.634523 29565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:23.635720 1181 raft_consensus.cc:3032] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:23.636353 1181 raft_consensus.cc:729] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.636085 1145 consensus_queue.cc:1046] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:23.628509 1192 raft_consensus.cc:2726] T e6a9409698ac457faa20f77f1cf661a7 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:23.637403 1181 consensus_queue.cc:260] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.638927 1181 raft_consensus.cc:3037] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:23.635752 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:23.627815 1282 consensus_meta.cc:287] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a: Time spent flushing consensus metadata: real 0.640s user 0.013s sys 0.002s
I20260807 15:11:23.640268 1314 consensus_queue.cc:1046] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260807 15:11:23.642656 29449 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:23.650178 1192 raft_consensus.cc:2726] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:23.660748 30273 leader_election.cc:302] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:23.661060 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a0ef49386d543e6bf09732d79976e83" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.661952 1260 raft_consensus.cc:2726] T 748d0394657643cfbf71e2bac60ff2f2 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:23.660848 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.662639 29641 raft_consensus.cc:2362] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 10. Re-sending same reply.
I20260807 15:11:23.663765 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afaa655e923f4aecbeee1b026c46810e" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.664009 29638 raft_consensus.cc:1226] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:23.665472 29564 raft_consensus.cc:2454] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:23.666563 1350 consensus_queue.cc:1035] T 1177fe2445db43e2b8366f33a841a041 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 15:11:23.667023 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db6cf72c3b74ea19f67f0d479e0b364" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.668331 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.670725 29638 raft_consensus.cc:1261] T ca67c90d21974f08892e272b90a83ac0 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260807 15:11:23.671046 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41559fba51e74c12a634f00bc225cd7b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.671671 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "242c77eb4afe4fe39d26981ed5003ef2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.607784 1340 consensus_queue.cc:237] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.672230 29643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.672932 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.675725 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e098505a6248f0aa9d91084fbbe64e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.678293 1102 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:23.647699 29644 consensus_queue.cc:260] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.680712 29645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59992 (request call id 2666) took 1923 ms. Trace:
I20260807 15:11:23.656690 1351 raft_consensus.cc:504] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.681151 29645 rpcz_store.cc:276] 0807 15:11:21.756939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:23.199090 (+1442151us) service_pool.cc:227] Handling call
0807 15:11:23.227683 (+ 28593us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 15:11:23.389915 (+162232us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 15:11:23.389946 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 15:11:23.409679 (+ 19733us) log.cc:842] Serialized 52 byte log entry
0807 15:11:23.484889 (+ 75210us) raft_consensus.cc:1631] Marking committed up to 5
0807 15:11:23.484941 (+ 52us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 15:11:23.485012 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 15:11:23.680475 (+195463us) raft_consensus.cc:1671] finished
0807 15:11:23.680498 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 15:11:23.680637 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":16781,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"thread_start_us":43846,"threads_started":1,"wal-append.queue_time_us":184217}
I20260807 15:11:23.700022 29647 raft_consensus.cc:1226] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [term 11 LEADER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260807 15:11:23.702324 29487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72d26b2e21c544129f8af911afa3aa3a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.702929 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.706197 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.709582 29487 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:23.665097 1353 raft_consensus.cc:504] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.733515 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.712630 29609 leader_election.cc:302] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:23.705941 1047 consensus_queue.cc:1046] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260807 15:11:23.721174 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c48154e8c94a9c83e606db06e22092" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.713209 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "030a7060e7f744ff9a4e02ea0cd710bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.726367 1153 raft_consensus.cc:2726] T 3a1d390489b54758a0ce36af133f1d57 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:23.726925 29485 raft_consensus.cc:2379] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 8: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:23.729306 1074 raft_consensus.cc:504] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.730530 1351 leader_election.cc:288] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.731395 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.753023 29569 raft_consensus.cc:1226] T 2dfe227bf905440483bae2c8a294fb1b P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:23.753482 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6deeb6ab1b13402e953266974f24e09d" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.753404 1321 consensus_queue.cc:1046] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 15:11:23.754781 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23cf6497a87482cb9bd824261ba383f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.731825 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.732857 28227 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 15:11:23.739056 29482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.758697 29482 raft_consensus.cc:2379] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 7: Already voted for candidate 9bbe5c211ab64989a57350f34f007ced in this term.
I20260807 15:11:23.758725 1174 raft_consensus.cc:3032] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:23.759224 1174 raft_consensus.cc:729] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:23.759841 29481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c235e827abcd4d26adef777f50f15d3e" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.764916 29378 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48676 (request call id 368) took 11134 ms. Trace:
I20260807 15:11:23.766870 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.767040 1249 leader_election.cc:288] T fa52dbe02da546099c32896b927af8e2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.738831 29382 catalog_manager.cc:5495] T e0c073edf1454d1589526a840754b5da P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 5 to 6, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 6 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
W20260807 15:11:23.767458 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 54920.8us
I20260807 15:11:23.767680 30307 raft_consensus.cc:2379] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a in current term 7: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:23.738724 1357 raft_consensus.cc:3032] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Stepping down as leader of term 10
I20260807 15:11:23.768280 1357 raft_consensus.cc:729] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:23.768512 29382 catalog_manager.cc:5495] T 995314457256466c935b10a561d7003e P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 4 to 5, leader changed from 9bbe5c211ab64989a57350f34f007ced (127.27.144.193) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 5 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } }
I20260807 15:11:23.769309 1357 consensus_queue.cc:260] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.769960 1321 raft_consensus.cc:2726] T f07d982710354dfca721e4641d589839 P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 15:11:23.770746 1357 raft_consensus.cc:3037] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:23.772296 29481 raft_consensus.cc:1226] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:23.745623 30311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62050f8fd36a4c19bd25be548475deb7" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.746059 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "530a2932f7854f95a0380cbbf05f57bf" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.741194 1340 raft_consensus.cc:482] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:23.776932 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.776721 1340 raft_consensus.cc:504] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.777714 29483 raft_consensus.cc:2454] T fdb4dc5833b24c4092e293f2ad6736bd P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 8.
I20260807 15:11:23.747105 29484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3d1cf6540694063929e5d2508204bd1" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:23.748715 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 57161.5us
I20260807 15:11:23.778702 29483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.749399 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1177fe2445db43e2b8366f33a841a041" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.780205 29646 raft_consensus.cc:2454] T 1177fe2445db43e2b8366f33a841a041 P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 10.
I20260807 15:11:23.780745 29483 raft_consensus.cc:1226] T 242c77eb4afe4fe39d26981ed5003ef2 P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:23.782438 1306 consensus_queue.cc:1046] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:11:23.782835 29608 leader_election.cc:302] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:23.785597 1181 raft_consensus.cc:2781] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:23.785516 1145 consensus_queue.cc:1035] T ca67c90d21974f08892e272b90a83ac0 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:23.786180 1116 consensus_queue.cc:1046] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:11:23.786598 1181 raft_consensus.cc:686] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.760257 1174 consensus_queue.cc:260] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.762351 30274 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:23.739578 1317 raft_consensus.cc:3032] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 15:11:23.758054 28227 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 15:11:23.762837 29486 raft_consensus.cc:1226] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:23.765554 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:23.772428 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:23.769266 1342 raft_consensus.cc:3032] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:23.736518 29450 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:23.783838 1371 raft_consensus.cc:3032] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:23.783694 1297 consensus_queue.cc:1046] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:23.783826 29449 leader_election.cc:302] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:23.784507 1170 consensus_queue.cc:1046] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 15:11:23.810050 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b28d0b706f4cacbfda48dd13e4d700" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
W20260807 15:11:23.810463 30274 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 48190.4us
I20260807 15:11:23.787648 1171 raft_consensus.cc:3032] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:23.814813 1171 raft_consensus.cc:729] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.815086 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d695ebbb554e07b7258dc4e0368ce8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:23.816062 1353 leader_election.cc:288] T 574818cf180d48a68d8b72da65c22af5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.815801 1171 consensus_queue.cc:260] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.817255 1171 raft_consensus.cc:3037] T 4fbc64c4dbd34587a70422db1adc925c P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
W20260807 15:11:23.817657 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 106559us
I20260807 15:11:23.750197 1288 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.750281 29480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c10b42b2212f45838c83e394b00482df" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced" is_pre_election: true
I20260807 15:11:23.820940 1031 raft_consensus.cc:2726] T 41559fba51e74c12a634f00bc225cd7b P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:23.821534 30305 raft_consensus.cc:2454] T c235e827abcd4d26adef777f50f15d3e P fbf78964d70448269802ac7de9d7a198 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 10.
I20260807 15:11:23.821969 1102 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
W20260807 15:11:23.802780 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 57802.9us
I20260807 15:11:23.823738 30273 leader_election.cc:302] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:23.824245 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.825182 678 consensus_queue.cc:1035] T c8cd23e547af4b6eb4c91c08c1ce7d9a P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 15:11:23.825853 1329 raft_consensus.cc:2781] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 15:11:23.826262 1170 raft_consensus.cc:2781] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 15:11:23.826673 1260 consensus_queue.cc:1046] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:23.827507 1297 raft_consensus.cc:3032] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:23.801498 29637 raft_consensus.cc:2454] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 11.
I20260807 15:11:23.813710 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "995314457256466c935b10a561d7003e" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.804593 1371 raft_consensus.cc:729] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:23.826730 678 consensus_queue.cc:1046] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 15:11:23.819602 29450 leader_election.cc:302] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bbe5c211ab64989a57350f34f007ced; no voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270
I20260807 15:11:23.827941 1260 raft_consensus.cc:3032] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 15:11:23.798729 29487 raft_consensus.cc:2454] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:23.804402 29560 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 7.
I20260807 15:11:23.833868 29641 raft_consensus.cc:1226] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 10. Current term is 11. Ops: []
W20260807 15:11:23.738823 1392 log.cc:924] Time spent T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.097s user 0.000s sys 0.001s
I20260807 15:11:23.811086 29382 catalog_manager.cc:5495] T 748d0394657643cfbf71e2bac60ff2f2 P 00dd11bf8fd9487580aba733c2996a4a reported cstate change: term changed from 2 to 3, leader changed from 4b092f7f951b4137b5d7810056684270 (127.27.144.195) to 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194). New cstate: current_term: 3 leader_uuid: "00dd11bf8fd9487580aba733c2996a4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 15:11:23.715968 1373 consensus_queue.cc:1046] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260807 15:11:23.837595 30272 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:23.837826 29479 raft_consensus.cc:1226] T 995314457256466c935b10a561d7003e P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Rejecting Update request from peer 00dd11bf8fd9487580aba733c2996a4a for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260807 15:11:23.838317 29484 raft_consensus.cc:1226] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:23.839814 30310 raft_consensus.cc:1226] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 10. Current term is 11. Ops: []
I20260807 15:11:23.826287 1329 raft_consensus.cc:482] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:23.849984 1329 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Advancing to term 12
I20260807 15:11:23.799242 1317 raft_consensus.cc:729] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.852411 1317 consensus_queue.cc:260] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.853893 1317 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 3 FOLLOWER]: Advancing to term 4
I20260807 15:11:23.841138 29644 raft_consensus.cc:3037] T b45f04f91dc84b71b311beec0d34d756 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:23.826756 1170 raft_consensus.cc:482] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:23.857177 1170 raft_consensus.cc:3037] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:23.841550 29488 raft_consensus.cc:1261] T b6072ace00c943b19f41dba76504e780 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Refusing update from remote peer 00dd11bf8fd9487580aba733c2996a4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 15:11:23.841591 29486 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:23.829311 1297 raft_consensus.cc:729] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.860955 1355 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.861012 1297 consensus_queue.cc:260] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.861541 1355 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.786835 1144 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.862589 1297 raft_consensus.cc:3037] T e6a9409698ac457faa20f77f1cf661a7 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:23.833635 1260 raft_consensus.cc:729] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.864949 1361 raft_consensus.cc:3032] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:23.865195 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:23.864938 1260 consensus_queue.cc:260] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.866149 860 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:23.866626 1260 raft_consensus.cc:3037] T b1d695ebbb554e07b7258dc4e0368ce8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:23.867264 1355 leader_election.cc:288] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.834431 1145 raft_consensus.cc:2726] T b45f04f91dc84b71b311beec0d34d756 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:23.848438 1249 raft_consensus.cc:482] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.868875 1144 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:23.865552 1361 raft_consensus.cc:729] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.870035 1361 consensus_queue.cc:260] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.871632 1361 raft_consensus.cc:3037] T 574818cf180d48a68d8b72da65c22af5 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:23.868582 1249 raft_consensus.cc:504] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.878230 1249 leader_election.cc:288] T 530a2932f7854f95a0380cbbf05f57bf P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.801976 1342 raft_consensus.cc:729] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.879385 1342 consensus_queue.cc:260] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.880926 1342 raft_consensus.cc:3037] T b6072ace00c943b19f41dba76504e780 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:23.870640 30305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
W20260807 15:11:23.873085 29449 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 44074.7us
I20260807 15:11:23.843065 1353 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.884862 1145 consensus_queue.cc:1046] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260807 15:11:23.886096 1145 raft_consensus.cc:3032] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Stepping down as leader of term 10
I20260807 15:11:23.886651 1145 raft_consensus.cc:729] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:23.887653 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fd4477c59ed4f0181a2d23b25c4a030" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.888465 29646 raft_consensus.cc:2454] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bbe5c211ab64989a57350f34f007ced in term 4.
I20260807 15:11:23.888967 29637 raft_consensus.cc:1226] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:23.887732 1145 consensus_queue.cc:260] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.875653 1371 consensus_queue.cc:260] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.876304 1375 raft_consensus.cc:2781] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader election won for term 11
I20260807 15:11:23.873934 1174 raft_consensus.cc:3037] T d87368aeb34548079f36255279bee400 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:23.890703 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:23.890810 1375 raft_consensus.cc:686] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [term 11 LEADER]: Becoming Leader. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.808005 1376 consensus_queue.cc:1046] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260807 15:11:23.844399 1288 consensus_queue.cc:1046] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:11:23.893082 1247 raft_consensus.cc:3032] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:23.893510 1247 raft_consensus.cc:729] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fbf78964d70448269802ac7de9d7a198, State: Running, Role: LEADER
I20260807 15:11:23.893301 1375 consensus_queue.cc:237] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.894497 1247 consensus_queue.cc:260] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.845990 1321 raft_consensus.cc:3032] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:23.896144 1321 raft_consensus.cc:729] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:23.897117 1321 consensus_queue.cc:260] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:23.898419 1321 raft_consensus.cc:3037] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:23.899492 1371 raft_consensus.cc:3037] T c10b42b2212f45838c83e394b00482df P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:23.884809 1353 raft_consensus.cc:504] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:23.899955 29449 leader_election.cc:302] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:23.901832 1353 leader_election.cc:288] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:23.903035 29646 raft_consensus.cc:1261] T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 15:11:23.861639 1102 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 15:11:23.904702 1247 raft_consensus.cc:3037] T 030a7060e7f744ff9a4e02ea0cd710bd P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Advancing to term 7
W20260807 15:11:23.904664 1306 consensus_queue.cc:1159] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fbf78964d70448269802ac7de9d7a198" responder_term: 11 status { last_received { term: 10 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260807 15:11:23.915163 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.196:43545, user_credentials={real_user=slave}} blocked reactor thread for 65844us
I20260807 15:11:23.924711 678 consensus_queue.cc:1035] T 9fd4477c59ed4f0181a2d23b25c4a030 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 15:11:23.952296 30309 raft_consensus.cc:1226] T c10b42b2212f45838c83e394b00482df P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:23.840402 1192 raft_consensus.cc:2726] T 72d26b2e21c544129f8af911afa3aa3a P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 15:11:23.956988 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 184647us
W20260807 15:11:23.963619 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 121675us
I20260807 15:11:23.890843 1145 raft_consensus.cc:3037] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Advancing to term 11
I20260807 15:11:23.974104 29646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "9bbe5c211ab64989a57350f34f007ced" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:23.963480 1118 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:23.961547 1340 leader_election.cc:288] T 2dfe227bf905440483bae2c8a294fb1b P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:24.000015 29533 leader_election.cc:302] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:23.766705 29378 rpcz_store.cc:276] 0807 15:11:12.630788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 15:11:12.631064 (+ 276us) service_pool.cc:227] Handling call
0807 15:11:23.764678 (+11133614us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 15:11:17.925381 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 15:11:18.184344 (+258963us) write_op.cc:432] Acquiring schema lock in shared mode
0807 15:11:18.184416 (+ 72us) write_op.cc:435] Acquired schema lock
0807 15:11:18.184431 (+ 15us) tablet.cc:660] Decoding operations
0807 15:11:18.185132 (+ 701us) write_op.cc:620] Acquiring the partition lock for write op
0807 15:11:18.185302 (+ 170us) write_op.cc:641] Partition lock acquired for write op
0807 15:11:18.185362 (+ 60us) tablet.cc:683] Acquiring locks for 1 operations
0807 15:11:18.185792 (+ 430us) tablet.cc:699] Row locks acquired
0807 15:11:18.185809 (+ 17us) write_op.cc:260] PREPARE: finished
0807 15:11:18.186080 (+ 271us) write_op.cc:270] Start()
0807 15:11:18.186264 (+ 184us) write_op.cc:276] Timestamp: P: 1786115478186001 usec, L: 0
0807 15:11:18.186282 (+ 18us) op_driver.cc:331] REPLICATION: starting
0807 15:11:18.187361 (+ 1079us) log.cc:842] Serialized 505 byte log entry
0807 15:11:20.025370 (+1838009us) op_driver.cc:444] REPLICATION: finished
0807 15:11:20.518806 (+493436us) write_op.cc:301] APPLY: starting
0807 15:11:20.518913 (+ 107us) tablet.cc:1365] starting BulkCheckPresence
0807 15:11:20.519138 (+ 225us) tablet.cc:1368] finished BulkCheckPresence
0807 15:11:20.519245 (+ 107us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 15:11:20.519434 (+ 189us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 15:11:20.519620 (+ 186us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 15:11:20.519661 (+ 41us) write_op.cc:312] APPLY: finished
0807 15:11:20.519863 (+ 202us) log.cc:842] Serialized 23 byte log entry
0807 15:11:20.520071 (+ 208us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:20.520179 (+ 108us) write_op.cc:454] Released schema lock
0807 15:11:20.541083 (+ 20904us) write_op.cc:341] FINISH: Updating metrics
0807 15:11:20.568151 (+ 27068us) write_op.cc:489] Releasing partition, row and schema locks
0807 15:11:20.575352 (+ 7201us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176722,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":493047,"apply.run_cpu_time_us":2844,"apply.run_wall_time_us":84226,"num_ops":1,"prepare.queue_time_us":958723,"prepare.run_cpu_time_us":42072,"prepare.run_wall_time_us":1179661,"raft.queue_time_us":661381,"raft.run_cpu_time_us":38211,"raft.run_wall_time_us":435171,"replication_time_us":1838948,"thread_start_us":2142539,"threads_started":4,"wal-append.queue_time_us":1172650,"wal-append.run_cpu_time_us":31301,"wal-append.run_wall_time_us":2271495}]]}
I20260807 15:11:24.005646 1355 raft_consensus.cc:2781] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:24.018177 1249 raft_consensus.cc:2726] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 15:11:24.018365 1280 raft_consensus.cc:482] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:24.028419 30311 raft_consensus.cc:1261] T 81993fd783554e64b26c4f0c2344bf53 P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 9bbe5c211ab64989a57350f34f007ced: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 15:11:24.007326 1118 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.016305 1342 raft_consensus.cc:3032] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:24.034749 29608 leader_election.cc:302] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.036854 1118 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:24.034142 29533 leader_election.cc:302] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:24.012439 1116 consensus_queue.cc:1046] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260807 15:11:24.007475 1181 consensus_queue.cc:237] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.057401 1293 raft_consensus.cc:2781] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:24.057545 29533 leader_election.cc:302] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:24.057988 1293 raft_consensus.cc:482] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:24.058435 1293 raft_consensus.cc:3037] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:24.058977 29533 leader_election.cc:302] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:24.010591 1329 raft_consensus.cc:504] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.062243 1282 raft_consensus.cc:2726] T 18498fa007b248e9af1c1eaeee728541 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:24.066745 1373 raft_consensus.cc:2781] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:24.067234 1116 raft_consensus.cc:3032] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 15:11:24.067333 1373 raft_consensus.cc:686] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.067926 1116 raft_consensus.cc:729] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.068646 1373 consensus_queue.cc:237] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.069005 1116 consensus_queue.cc:260] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.070639 1116 raft_consensus.cc:3037] T 0f0c51854d34430796b3dedd4548f4d5 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:24.032568 1342 raft_consensus.cc:729] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:11:24.081727 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 118193us
I20260807 15:11:24.032538 1074 leader_election.cc:288] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 14 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:24.063911 29533 leader_election.cc:302] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:24.028654 1280 raft_consensus.cc:504] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.099247 1282 raft_consensus.cc:2781] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:24.079126 1249 raft_consensus.cc:2781] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader election won for term 6
I20260807 15:11:24.038170 1351 consensus_queue.cc:1035] T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260807 15:11:24.039711 1318 consensus_queue.cc:1046] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260807 15:11:24.060016 1334 consensus_queue.cc:1035] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260807 15:11:24.117470 1282 raft_consensus.cc:686] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:24.149092 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc305388a594a0f8be8d24006e0b323" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:24.131968 1249 raft_consensus.cc:686] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [term 6 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:24.156072 1170 raft_consensus.cc:504] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.157406 1314 raft_consensus.cc:3032] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:24.157189 1249 consensus_queue.cc:237] T e6a9409698ac457faa20f77f1cf661a7 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.157891 1314 raft_consensus.cc:729] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.158411 1170 leader_election.cc:288] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:24.145835 1329 leader_election.cc:288] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 12 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:24.160240 29637 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fbf78964d70448269802ac7de9d7a198 in current term 11: Already voted for candidate 4b092f7f951b4137b5d7810056684270 in this term.
I20260807 15:11:24.162582 1282 consensus_queue.cc:237] T 0f0c51854d34430796b3dedd4548f4d5 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.163062 1293 raft_consensus.cc:504] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.158885 1314 consensus_queue.cc:260] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.168913 1293 leader_election.cc:288] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
W20260807 15:11:24.165727 1403 log.cc:924] Time spent T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198: Append to log took a long time: real 0.109s user 0.002s sys 0.000s
I20260807 15:11:24.194510 29533 leader_election.cc:398] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6.
I20260807 15:11:24.194950 29533 leader_election.cc:401] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260807 15:11:24.160487 1342 consensus_queue.cc:260] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
W20260807 15:11:24.201148 29609 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 54800.7us
I20260807 15:11:24.204617 1355 raft_consensus.cc:482] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:24.205204 1355 raft_consensus.cc:3037] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:24.211834 1314 raft_consensus.cc:3037] T 37e098505a6248f0aa9d91084fbbe64e P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
W20260807 15:11:24.214964 29369 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.209s user 0.015s sys 0.002s
I20260807 15:11:24.218381 1325 raft_consensus.cc:3032] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:24.218894 1325 raft_consensus.cc:729] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.219841 1325 consensus_queue.cc:260] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.221160 1325 raft_consensus.cc:3037] T 72d26b2e21c544129f8af911afa3aa3a P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:24.222822 1293 raft_consensus.cc:2726] T 81993fd783554e64b26c4f0c2344bf53 P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125) with higher term. Message: Invalid argument: T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 5. Current term is 6.
I20260807 15:11:24.224395 29609 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
W20260807 15:11:24.225435 1410 log.cc:924] Time spent T 9fd4477c59ed4f0181a2d23b25c4a030 P 4b092f7f951b4137b5d7810056684270: Append to log took a long time: real 0.077s user 0.002s sys 0.000s
I20260807 15:11:24.225662 29609 leader_election.cc:302] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.225904 1342 raft_consensus.cc:3037] T fa52dbe02da546099c32896b927af8e2 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:24.227226 1047 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260807 15:11:24.229887 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 89808.9us
I20260807 15:11:24.231138 29533 leader_election.cc:302] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:24.231235 1319 raft_consensus.cc:2726] T 7645f7cacdb34a1486686ba6f848e1bb P 4b092f7f951b4137b5d7810056684270 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 15:11:24.196108 29608 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 122125us
I20260807 15:11:24.233723 1144 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:24.234513 1334 consensus_queue.cc:1046] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 15:11:24.227677 1047 raft_consensus.cc:482] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:24.235476 30272 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbf78964d70448269802ac7de9d7a198; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:24.234344 29533 leader_election.cc:302] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:24.234324 1144 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.231331 29609 leader_election.cc:302] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:24.218429 1280 leader_election.cc:288] T b1d288f694924e79826a10fc7cff8351 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:24.247745 1047 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:24.247424 1293 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:24.248742 1260 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260807 15:11:24.257318 1411 raft_consensus.cc:3037] T 995314457256466c935b10a561d7003e P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:24.268092 30305 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260807 15:11:24.252326 1118 raft_consensus.cc:2781] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:24.269918 29533 leader_election.cc:302] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.268500 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:24.277212 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:24.277938 30309 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 13 FOLLOWER]: Advancing to term 14
I20260807 15:11:24.278729 1118 raft_consensus.cc:686] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [term 8 LEADER]: Becoming Leader. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:24.279738 1118 consensus_queue.cc:237] T 4fbc64c4dbd34587a70422db1adc925c P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.248445 1353 consensus_queue.cc:1046] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260807 15:11:24.294765 29533 leader_election.cc:302] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.286392 30310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198" is_pre_election: true
I20260807 15:11:24.292595 30307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29795442e1dd46f3becb9daf1bd74aef" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:24.311658 30307 raft_consensus.cc:2379] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b092f7f951b4137b5d7810056684270 in current term 11: Already voted for candidate fbf78964d70448269802ac7de9d7a198 in this term.
I20260807 15:11:24.320645 30310 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P fbf78964d70448269802ac7de9d7a198 [term 11 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 10. Current term is 11. Ops: []
I20260807 15:11:24.323796 29609 leader_election.cc:302] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.323830 29627 tablet_service.cc:1514] Processing DeleteTablet for tablet 81993fd783554e64b26c4f0c2344bf53 with delete_type TABLET_DATA_TOMBSTONED (TS 4b092f7f951b4137b5d7810056684270 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46792
I20260807 15:11:24.255415 1297 consensus_queue.cc:1046] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260807 15:11:24.325542 29609 leader_election.cc:302] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.324990 1373 raft_consensus.cc:2726] T e1b28d0b706f4cacbfda48dd13e4d700 P 4b092f7f951b4137b5d7810056684270 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 15:11:24.305485 29369 maintenance_manager.cc:643] P ce1e7c41f736452080b21dd983c40ba5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 11.968s user 0.237s sys 0.061s Metrics: {"bytes_written":30280,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":921951,"dirs.run_cpu_time_us":741,"dirs.run_wall_time_us":54129,"drs_written":1,"lbm_read_time_us":26364,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":2,"lbm_write_time_us":300664,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":32545152,"thread_start_us":1056763,"threads_started":3,"update_count":10,"wal-append.queue_time_us":192751}
I20260807 15:11:24.332646 29609 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:24.338793 1321 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 15:11:24.338646 1352 consensus_queue.cc:1046] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 15:11:24.339293 1321 raft_consensus.cc:482] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:24.339664 1352 consensus_queue.cc:1225] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [LEADER]: Peer fbf78964d70448269802ac7de9d7a198 log is divergent from this leader: its last log entry 9.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260807 15:11:24.339728 1321 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:24.342173 1352 raft_consensus.cc:3032] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Stepping down as leader of term 10
I20260807 15:11:24.342579 1352 raft_consensus.cc:729] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bbe5c211ab64989a57350f34f007ced, State: Running, Role: LEADER
I20260807 15:11:24.344437 29609 leader_election.cc:302] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.346536 29533 leader_election.cc:302] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.351845 1352 consensus_queue.cc:260] T 29795442e1dd46f3becb9daf1bd74aef P 9bbe5c211ab64989a57350f34f007ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.356141 1321 raft_consensus.cc:504] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.358449 1321 leader_election.cc:288] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Requested vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), fbf78964d70448269802ac7de9d7a198 (127.27.144.196:43545)
I20260807 15:11:24.360491 29608 leader_election.cc:302] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:24.362044 29608 leader_election.cc:302] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:24.363755 1407 raft_consensus.cc:2726] T 6deeb6ab1b13402e953266974f24e09d P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 15:11:24.364554 1407 raft_consensus.cc:2781] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 15:11:24.364997 1407 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:24.365466 1407 raft_consensus.cc:3037] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Advancing to term 7
I20260807 15:11:24.314428 1047 raft_consensus.cc:504] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.367884 1288 raft_consensus.cc:979] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270: : Instructing follower 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:24.369192 29609 leader_election.cc:302] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.372706 29637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9172782dc9b949dca48f386dd0afe164" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:24.374909 1116 raft_consensus.cc:2726] T c10b42b2212f45838c83e394b00482df P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:24.375061 29609 leader_election.cc:302] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters: 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:24.369378 1171 raft_consensus.cc:2726] T f23cf6497a87482cb9bd824261ba383f P 4b092f7f951b4137b5d7810056684270 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 15:11:24.371635 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:24.380438 30309 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P fbf78964d70448269802ac7de9d7a198 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 14.
I20260807 15:11:24.388860 29641 raft_consensus.cc:2354] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 7. Current term is 8.
I20260807 15:11:24.330307 1280 raft_consensus.cc:2726] T afaa655e923f4aecbeee1b026c46810e P 00dd11bf8fd9487580aba733c2996a4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 15:11:24.389775 29488 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 9bbe5c211ab64989a57350f34f007ced [term 11 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260807 15:11:24.372542 1170 raft_consensus.cc:1067] T fdb4dc5833b24c4092e293f2ad6736bd P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Signalling peer 00dd11bf8fd9487580aba733c2996a4a to start an election
I20260807 15:11:24.335796 1181 raft_consensus.cc:2726] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260807 15:11:24.396829 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 50446.8us
I20260807 15:11:24.403136 29533 leader_election.cc:302] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.405494 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fc8adcf9402487ca81d7c0edc5dd599" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.330037 1249 raft_consensus.cc:2726] T 0a0ef49386d543e6bf09732d79976e83 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 15:11:24.410429 29644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8cd23e547af4b6eb4c91c08c1ce7d9a" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:24.410550 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3465aa175594b588334678fe9eee6cb" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.399803 29609 leader_election.cc:302] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:24.411515 29640 raft_consensus.cc:2454] T b3465aa175594b588334678fe9eee6cb P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 7.
I20260807 15:11:24.385690 1171 raft_consensus.cc:2781] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 15:11:24.427765 29642 raft_consensus.cc:1261] T c3d1cf6540694063929e5d2508204bd1 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Refusing update from remote peer fbf78964d70448269802ac7de9d7a198: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260807 15:11:24.388584 1282 raft_consensus.cc:2726] T 4db6cf72c3b74ea19f67f0d479e0b364 P 00dd11bf8fd9487580aba733c2996a4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260807 15:11:24.427929 29641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dfe227bf905440483bae2c8a294fb1b" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.370692 1047 leader_election.cc:288] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 election: Requested vote from peers 9bbe5c211ab64989a57350f34f007ced (127.27.144.193:39125), 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589)
I20260807 15:11:24.401855 1319 raft_consensus.cc:3032] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 15:11:24.430866 29533 leader_election.cc:302] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.370258 1317 consensus_queue.cc:1046] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260807 15:11:24.433717 29609 leader_election.cc:302] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b092f7f951b4137b5d7810056684270; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.441334 29638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.432685 30309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fbf78964d70448269802ac7de9d7a198"
I20260807 15:11:24.445011 30309 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:24.398041 1321 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260807 15:11:24.446712 29640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca67c90d21974f08892e272b90a83ac0" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.451753 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:24.452497 29479 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:24.444269 1102 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260807 15:11:24.456439 29645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa52dbe02da546099c32896b927af8e2" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.449826 1144 leader_election.cc:288] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:24.460551 1317 raft_consensus.cc:2726] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260807 15:11:24.461150 1334 raft_consensus.cc:3032] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 15:11:24.461560 1334 raft_consensus.cc:729] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.464767 30310 raft_consensus.cc:1226] T acc305388a594a0f8be8d24006e0b323 P fbf78964d70448269802ac7de9d7a198 [term 12 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 11. Current term is 12. Ops: []
I20260807 15:11:24.467482 29479 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 10.
I20260807 15:11:24.442842 1170 raft_consensus.cc:2781] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 14 FOLLOWER]: Leader election won for term 14
I20260807 15:11:24.431612 1353 raft_consensus.cc:2726] T 00c48154e8c94a9c83e606db06e22092 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:24.482467 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "fbf78964d70448269802ac7de9d7a198" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.498431 29647 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbf78964d70448269802ac7de9d7a198 in term 4.
I20260807 15:11:24.477474 1171 raft_consensus.cc:686] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [term 10 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.433737 1319 raft_consensus.cc:729] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.508814 29642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.475095 1282 raft_consensus.cc:2726] T 030a7060e7f744ff9a4e02ea0cd710bd P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260807 15:11:24.499526 1392 log.cc:924] Time spent T 81993fd783554e64b26c4f0c2344bf53 P 9bbe5c211ab64989a57350f34f007ced: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260807 15:11:24.513350 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a11f5d18a564611b87fe4b67e592ed8" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270" is_pre_election: true
I20260807 15:11:24.513607 29533 leader_election.cc:302] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
I20260807 15:11:24.514145 29647 raft_consensus.cc:2454] T 6a11f5d18a564611b87fe4b67e592ed8 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00dd11bf8fd9487580aba733c2996a4a in term 4.
I20260807 15:11:24.462513 1334 consensus_queue.cc:260] T 2dfe227bf905440483bae2c8a294fb1b P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.521849 29533 leader_election.cc:302] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 9bbe5c211ab64989a57350f34f007ced, fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.507990 29609 leader_election.cc:302] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced; no voters:
I20260807 15:11:24.517946 1260 consensus_queue.cc:1035] T c3d1cf6540694063929e5d2508204bd1 P fbf78964d70448269802ac7de9d7a198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260807 15:11:24.519527 30272 leader_election.cc:302] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:24.519994 29370 maintenance_manager.cc:419] P ce1e7c41f736452080b21dd983c40ba5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11098 bytes on disk
I20260807 15:11:24.539335 1428 tablet_replica.cc:330] T 81993fd783554e64b26c4f0c2344bf53 P 4b092f7f951b4137b5d7810056684270: stopping tablet replica
I20260807 15:11:24.539868 29561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8a4d13c18e42ff82894fddfb0c0f0f" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:24.540477 29561 raft_consensus.cc:3037] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 12 FOLLOWER]: Advancing to term 14
I20260807 15:11:24.544481 29569 raft_consensus.cc:1226] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:24.545730 29570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b3630618bf44ca9b6ede886159dab7a" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:24.546329 29570 raft_consensus.cc:3037] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Advancing to term 10
I20260807 15:11:24.547314 29432 placement_policy_util.cc:244] tablet 81993fd783554e64b26c4f0c2344bf53: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260807 15:11:24.548192 29560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fd4d41c286445e997322bdb49e97c65" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a" is_pre_election: true
I20260807 15:11:24.548368 29647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27275fe691bf4c42814ccca06801b625" candidate_uuid: "00dd11bf8fd9487580aba733c2996a4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b092f7f951b4137b5d7810056684270"
I20260807 15:11:24.548837 29560 raft_consensus.cc:2454] T 5fd4d41c286445e997322bdb49e97c65 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 5.
I20260807 15:11:24.549031 1181 consensus_queue.cc:1046] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 15:11:24.550143 1181 raft_consensus.cc:3032] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 11 LEADER]: Stepping down as leader of term 11
I20260807 15:11:24.550516 1181 raft_consensus.cc:729] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.506800 1170 raft_consensus.cc:686] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [term 14 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.566625 29608 leader_election.cc:302] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters: fbf78964d70448269802ac7de9d7a198
I20260807 15:11:24.538422 30309 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:24.507483 1174 raft_consensus.cc:482] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 00dd11bf8fd9487580aba733c2996a4a)
I20260807 15:11:24.552563 973 raft_consensus.cc:2781] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 15:11:24.536684 1325 raft_consensus.cc:2781] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 15:11:24.568611 29609 leader_election.cc:302] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b092f7f951b4137b5d7810056684270, fbf78964d70448269802ac7de9d7a198; no voters:
I20260807 15:11:24.537474 1282 raft_consensus.cc:2781] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 15:11:24.567868 29561 raft_consensus.cc:2454] T fb8a4d13c18e42ff82894fddfb0c0f0f P 00dd11bf8fd9487580aba733c2996a4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 14.
I20260807 15:11:24.574662 29568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3518672558d94e27a30f3efea0bbeab6" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
I20260807 15:11:24.580356 29568 raft_consensus.cc:3037] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Advancing to term 8
I20260807 15:11:24.578787 29369 maintenance_manager.cc:643] P ce1e7c41f736452080b21dd983c40ba5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.024s user 0.003s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":589,"lbm_reads_lt_1ms":4}
I20260807 15:11:24.574363 29560 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fdb4dc5833b24c4092e293f2ad6736bd"
dest_uuid: "00dd11bf8fd9487580aba733c2996a4a"
from {username='slave'} at 127.0.0.1:59874
I20260807 15:11:24.510547 1171 consensus_queue.cc:237] T c235e827abcd4d26adef777f50f15d3e P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 9.12, Last appended by leader: 12, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.593786 29570 raft_consensus.cc:2454] T 9b3630618bf44ca9b6ede886159dab7a P 00dd11bf8fd9487580aba733c2996a4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 10.
I20260807 15:11:24.565088 1280 raft_consensus.cc:2726] T b1d695ebbb554e07b7258dc4e0368ce8 P 00dd11bf8fd9487580aba733c2996a4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 15:11:24.598189 30307 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P fbf78964d70448269802ac7de9d7a198 [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260807 15:11:24.551432 1181 consensus_queue.cc:260] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.574731 973 raft_consensus.cc:482] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:11:24.572894 1321 raft_consensus.cc:2781] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 15:11:24.603154 29568 raft_consensus.cc:2454] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b092f7f951b4137b5d7810056684270 in term 8.
I20260807 15:11:24.585342 1282 raft_consensus.cc:482] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b092f7f951b4137b5d7810056684270)
I20260807 15:11:24.584537 1288 raft_consensus.cc:2781] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 15:11:24.641834 30307 raft_consensus.cc:1261] T e9b0eecfdf5242a3b82bc6217faa4b96 P fbf78964d70448269802ac7de9d7a198 [term 8 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260807 15:11:24.642446 29484 raft_consensus.cc:1261] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 11 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260807 15:11:24.643007 29484 pending_rounds.cc:76] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Aborting all ops after (but not including) 8
I20260807 15:11:24.643318 29484 pending_rounds.cc:97] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260807 15:11:24.643664 29484 raft_consensus.cc:2866] T 990a0811150c4c53ae50cc69c71f2926 P 9bbe5c211ab64989a57350f34f007ced [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 15:11:24.643806 1317 consensus_queue.cc:1035] T e9b0eecfdf5242a3b82bc6217faa4b96 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 15:11:24.620886 1314 consensus_queue.cc:1035] T b67938f915c84df3a2da7adba02b898b P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260807 15:11:24.597834 1325 raft_consensus.cc:686] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [term 10 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
I20260807 15:11:24.647547 1407 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 4b092f7f951b4137b5d7810056684270 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.625437 973 raft_consensus.cc:3037] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 4 FOLLOWER]: Advancing to term 5
I20260807 15:11:24.571810 1047 consensus_queue.cc:1046] T 9172782dc9b949dca48f386dd0afe164 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260807 15:11:24.750176 29570 raft_consensus.cc:1226] T 62050f8fd36a4c19bd25be548475deb7 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:24.737768 1293 raft_consensus.cc:2726] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 15:11:24.753096 29640 raft_consensus.cc:1226] T 29795442e1dd46f3becb9daf1bd74aef P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Rejecting Update request from peer 9bbe5c211ab64989a57350f34f007ced for earlier term 10. Current term is 11. Ops: []
I20260807 15:11:24.625371 1321 raft_consensus.cc:482] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:24.650100 1282 raft_consensus.cc:3037] T fdb4dc5833b24c4092e293f2ad6736bd P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Advancing to term 9
W20260807 15:11:24.758961 29531 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.195:33653, user_credentials={real_user=slave}} blocked reactor thread for 209323us
I20260807 15:11:24.593187 1174 raft_consensus.cc:504] T 1177fe2445db43e2b8366f33a841a041 P 9bbe5c211ab64989a57350f34f007ced [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } attrs { replace: true } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.765125 29565 raft_consensus.cc:1226] T 242c77eb4afe4fe39d26981ed5003ef2 P 00dd11bf8fd9487580aba733c2996a4a [term 9 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 8. Current term is 9. Ops: []
I20260807 15:11:24.575662 1319 consensus_queue.cc:260] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.754424 1288 raft_consensus.cc:686] T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 8 LEADER]: Becoming Leader. State: Replica: 4b092f7f951b4137b5d7810056684270, State: Running, Role: LEADER
W20260807 15:11:24.772603 29533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.144.193:39125, user_credentials={real_user=slave}} blocked reactor thread for 234009us
I20260807 15:11:24.630930 1355 raft_consensus.cc:504] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.762248 1181 raft_consensus.cc:3037] T acc305388a594a0f8be8d24006e0b323 P 4b092f7f951b4137b5d7810056684270 [term 11 FOLLOWER]: Advancing to term 12
I20260807 15:11:24.761402 1321 raft_consensus.cc:3037] T 5fd4d41c286445e997322bdb49e97c65 P 4b092f7f951b4137b5d7810056684270 [term 5 FOLLOWER]: Advancing to term 6
I20260807 15:11:24.765754 1350 raft_consensus.cc:3032] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 15:11:24.799341 29486 raft_consensus.cc:1226] T 9fd4477c59ed4f0181a2d23b25c4a030 P 9bbe5c211ab64989a57350f34f007ced [term 5 FOLLOWER]: Rejecting Update request from peer fbf78964d70448269802ac7de9d7a198 for earlier term 4. Current term is 5. Ops: []
I20260807 15:11:24.800127 29533 leader_election.cc:302] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 9bbe5c211ab64989a57350f34f007ced; no voters: 4b092f7f951b4137b5d7810056684270
W20260807 15:11:24.803907 29450 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 179468us
I20260807 15:11:24.760442 1408 consensus_queue.cc:1035] T 990a0811150c4c53ae50cc69c71f2926 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260807 15:11:24.793334 1371 raft_consensus.cc:482] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 15:11:24.804836 30273 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.144.194:33589, user_credentials={real_user=slave}} blocked reactor thread for 67688.2us
I20260807 15:11:24.812011 29531 leader_election.cc:302] T 9172782dc9b949dca48f386dd0afe164 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a; no voters: 4b092f7f951b4137b5d7810056684270, 9bbe5c211ab64989a57350f34f007ced
I20260807 15:11:24.795746 1350 raft_consensus.cc:729] T 3a1d390489b54758a0ce36af133f1d57 P 00dd11bf8fd9487580aba733c2996a4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 00dd11bf8fd9487580aba733c2996a4a, State: Running, Role: LEADER
I20260807 15:11:24.768764 1170 consensus_queue.cc:237] T fb8a4d13c18e42ff82894fddfb0c0f0f P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196" port: 43545 } attrs { promote: false } }
I20260807 15:11:24.808040 1351 raft_consensus.cc:482] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:24.810071 1319 raft_consensus.cc:3037] T 242c77eb4afe4fe39d26981ed5003ef2 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Advancing to term 9
I20260807 15:11:24.812063 1306 raft_consensus.cc:482] T 0f0c51854d34430796b3dedd4548f4d5 P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:24.830237 29531 leader_election.cc:398] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 7. Current term is 8.
I20260807 15:11:24.831229 29531 leader_election.cc:401] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260807 15:11:24.847584 29561 raft_consensus.cc:1226] T 27275fe691bf4c42814ccca06801b625 P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Rejecting Update request from peer 4b092f7f951b4137b5d7810056684270 for earlier term 6. Current term is 7. Ops: []
I20260807 15:11:24.827032 1293 raft_consensus.cc:2781] T 72d26b2e21c544129f8af911afa3aa3a P 00dd11bf8fd9487580aba733c2996a4a [term 7 FOLLOWER]: Leader election won for term 7
I20260807 15:11:24.816560 1314 consensus_queue.cc:1046] T 62050f8fd36a4c19bd25be548475deb7 P 4b092f7f951b4137b5d7810056684270 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260807 15:11:24.834784 1317 raft_consensus.cc:482] T 2fe1df4603dd4ecdad74103a84926118 P 4b092f7f951b4137b5d7810056684270 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:24.855819 29531 leader_election.cc:302] T b3465aa175594b588334678fe9eee6cb P 00dd11bf8fd9487580aba733c2996a4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00dd11bf8fd9487580aba733c2996a4a, 4b092f7f951b4137b5d7810056684270; no voters:
I20260807 15:11:24.807614 1325 consensus_queue.cc:237] T 9b3630618bf44ca9b6ede886159dab7a P 4b092f7f951b4137b5d7810056684270 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.862413 29479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c073edf1454d1589526a840754b5da" candidate_uuid: "4b092f7f951b4137b5d7810056684270" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bbe5c211ab64989a57350f34f007ced"
I20260807 15:11:24.815858 1371 raft_consensus.cc:504] T e0c073edf1454d1589526a840754b5da P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.872397 29568 raft_consensus.cc:1261] T b67938f915c84df3a2da7adba02b898b P 00dd11bf8fd9487580aba733c2996a4a [term 6 FOLLOWER]: Refusing update from remote peer 4b092f7f951b4137b5d7810056684270: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260807 15:11:24.848798 1439 raft_consensus.cc:2726] T 3518672558d94e27a30f3efea0bbeab6 P 00dd11bf8fd9487580aba733c2996a4a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653) with higher term. Message: Invalid argument: T 3518672558d94e27a30f3efea0bbeab6 P 4b092f7f951b4137b5d7810056684270 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 00dd11bf8fd9487580aba733c2996a4a for earlier term 7. Current term is 8.
I20260807 15:11:24.874800 1145 raft_consensus.cc:482] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:11:24.882613 1145 raft_consensus.cc:504] T 4fbc64c4dbd34587a70422db1adc925c P 9bbe5c211ab64989a57350f34f007ced [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.827567 1351 raft_consensus.cc:504] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bbe5c211ab64989a57350f34f007ced" member_type: VOTER last_known_addr { host: "127.27.144.193" port: 39125 } } peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } }
I20260807 15:11:24.887439 1351 leader_election.cc:288] T b3465aa175594b588334678fe9eee6cb P 9bbe5c211ab64989a57350f34f007ced [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 00dd11bf8fd9487580aba733c2996a4a (127.27.144.194:33589), 4b092f7f951b4137b5d7810056684270 (127.27.144.195:33653)
I20260807 15:11:24.888027 1351 raft_consensus.cc:482] T c235e827abcd4d26adef777f50f15d3e P 9bbe5c211ab64989a57350f34f007ced [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fbf78964d70448269802ac7de9d7a198)
I20260807 15:11:24.886536 973 raft_consensus.cc:504] T 6a11f5d18a564611b87fe4b67e592ed8 P fbf78964d70448269802ac7de9d7a198 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "00dd11bf8fd9487580aba733c2996a4a" member_type: VOTER last_known_addr { host: "127.27.144.194" port: 33589 } } peers { permanent_uuid: "4b092f7f951b4137b5d7810056684270" member_type: VOTER last_known_addr { host: "127.27.144.195" port: 33653 } } peers { permanent_uuid: "fbf78964d70448269802ac7de9d7a198" member_type: VOTER last_known_addr { host: "127.27.144.196"